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Prefaces 


Preface to the Second English Edition 


Science has not stood still in the years since the first English edition of this book 
was published. For example, Fermat’s last theorem has been proved, the Poincaré 
conjecture is now a theorem, and the Higgs boson has been discovered. Other events 
in science, while not directly related to the contents of a textbook in classical math- 
ematical analysis, have indirectly led the author to learn something new, to think 
over something familiar, or to extend his knowledge and understanding. All of this 
additional knowledge and understanding end up being useful even when one speaks 
about something apparently completely unrelated.! 

In addition to the original Russian edition, the book has been published in En- 
glish, German, and Chinese. Various attentive multilingual readers have detected 
many errors in the text. Luckily, these are local errors, mostly misprints. They have 
assuredly all been corrected in this new edition. 

But the main difference between the second and first English editions is the addi- 
tion of a series of appendices to each volume. There are six of them in the first and 
five of them in the second. So as not to disturb the original text, they are placed at the 
end of each volume. The subjects of the appendices are diverse. They are meant to be 
useful to students (in mathematics and physics) as well as to teachers, who may be 
motivated by different goals. Some of the appendices are surveys, both prospective 
and retrospective. The final survey contains the most important conceptual achieve- 
ments of the whole course, which establish connections between analysis and other 
parts of mathematics as a whole. 


'There is a story about Erd6s, who, like Hadamard, lived a very long mathematical and human 
life. When he was quite old, a journalist who was interviewing him asked him about his age. Erdés 
replied, after deliberating a bit, “I remember that when I was very young, scientists established that 
the Earth was two billion years old. Now scientists assert that the Earth is four and a half billion 
years old. So, I am approximately two and a half billion years old.” 
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I was happy to learn that this book has proven to be useful, to some extent, not 
only to mathematicians, but also to physicists, and even to engineers from technical 
schools that promote a deeper study of mathematics. 

It is a real pleasure to see a new generation that thinks bigger, understands more 
deeply, and is able to do more than the generation on whose shoulders it grew. 


Moscow, Russia V. Zorich 
2015 


Preface to the First English Edition 


An entire generation of mathematicians has grown up during the time between the 
appearance of the first edition of this textbook and the publication of the fourth 
edition, a translation of which is before you. The book is familiar to many people, 
who either attended the lectures on which it is based or studied out of it, and who 
now teach others in universities all over the world. I am glad that it has become 
accessible to English-speaking readers. 

This textbook consists of two parts. It is aimed primarily at university students 
and teachers specializing in mathematics and natural sciences, and at all those who 
wish to see both the rigorous mathematical theory and examples of its effective use 
in the solution of real problems of natural science. 

The textbook exposes classical analysis as it is today, as an integral part of Mathe- 
matics in its interrelations with other modern mathematical courses such as algebra, 
differential geometry, differential equations, complex and functional analysis. 

The two chapters with which this second book begins, summarize and explain in 
a general form essentially all most important results of the first volume concerning 
continuous and differentiable functions, as well as differential calculus. The pres- 
ence of these two chapters makes the second book formally independent of the first 
one. This assumes, however, that the reader is sufficiently well prepared to get by 
without introductory considerations of the first part, which preceded the resulting 
formalism discussed here. This second book, containing both the differential calcu- 
lus in its generalized form and integral calculus of functions of several variables, 
developed up to the general formula of Newton—Leibniz—Stokes, thus acquires a 
certain unity and becomes more self-contained. 

More complete information on the textbook and some recommendations for its 
use in teaching can be found in the translations of the prefaces to the first and second 
Russian editions. 


Moscow, Russia V. Zorich 
2003 
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Preface to the Sixth Russian Edition 


On my own behalf and on behalf of future readers, I thank all those, living in dif- 
ferent countries, who had the possibility to inform the publisher or me personally 
about errors (typos, errors, omissions), found in Russian, English, German and Chi- 
nese editions of this textbook. 

As it turned out, the book has been also very useful to physicists; I am very 
happy about that. In any case, I really seek to accompany the formal theory with 
meaningful examples of its application both in mathematics and outside of it. 

The sixth edition contains a series of appendices that may be useful to students 
and lecturers. Firstly, some of the material is actually real lectures (for example, 
the transcription of two introductory survey lectures for students of first and third 
semesters), and, secondly, this is some mathematical information (sometimes of cur- 
rent interest, such as the relation between multidimensional geometry and the theory 
of probability), lying close to the main subject of the textbook. 


Moscow, Russia V. Zorich 
2011 


Prefaces to the Fifth, Fourth, Third and Second Russian Editions 
In the fifth edition all misprints of the fourth edition have been corrected. 


Moscow, Russia V. Zorich 
2006 


In the fourth edition all misprints that the author is aware of have been corrected. 


Moscow, Russia V. Zorich 
2002 


The third edition differs from the second only in local corrections (although in 
one case it also involves the correction of a proof) and in the addition of some 
problems that seem to me to be useful. 


Moscow, Russia V. Zorich 
2001 


In addition to the correction of all the misprints in the first edition of which the 
author is aware, the differences between the second edition and the first edition of 
this book are mainly the following. Certain sections on individual topics — for ex- 
ample, Fourier series and the Fourier transform — have been recast (for the better, 
IT hope). We have included several new examples of applications and new substantive 
problems relating to various parts of the theory and sometimes significantly extend- 
ing it. Test questions are given, as well as questions and problems from the midterm 
examinations. The list of further readings has been expanded. 
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Further information on the material and some characteristics of this second part 
of the course are given below in the preface to the first edition. 


Moscow, Russia V. Zorich 
1998 


Preface to the First Russian Edition 


The preface to the first part contained a rather detailed characterization of the course 
as a whole, and hence I confine myself here to some remarks on the content of the 
second part only. 

The basic material of the present volume consists on the one hand of multiple in- 
tegrals and line and surface integrals, leading to the generalized Stokes’ formula and 
some examples of its application, and on the other hand the machinery of series and 
integrals depending on a parameter, including Fourier series, the Fourier transform, 
and the presentation of asymptotic expansions. 

Thus, this Part 2 basically conforms to the curriculum of the second year of study 
in the mathematics departments of universities. 

So as not to impose rigid restrictions on the order of presentation of these two 
major topics during the two semesters, I have discussed them practically indepen- 
dently of each other. 

Chapters 9 and 10, with which this book begins, reproduce in compressed and 
generalized form, essentially all of the most important results that were obtained 
in the first part concerning continuous and differentiable functions. These chapters 
are starred and written as an appendix to Part 1. This appendix contains, however, 
many concepts that play a role in any exposition of analysis to mathematicians. 
The presence of these two chapters makes the second book formally independent 
of the first, provided the reader is sufficiently well prepared to get by without the 
numerous examples and introductory considerations that, in the first part, preceded 
the formalism discussed here. 

The main new material in the book, which is devoted to the integral calculus of 
several variables, begins in Chap. 11. One who has completed the first part may 
begin the second part of the course at this point without any loss of continuity in the 
ideas. 

The language of differential forms is explained and used in the discussion of the 
theory of line and surface integrals. All the basic geometric concepts and analytic 
constructions that later form a scale of abstract definitions leading to the generalized 
Stokes’ formula are first introduced by using elementary material. 

Chapter 15 is devoted to a similar summary exposition of the integration of dif- 
ferential forms on manifolds. I regard this chapter as a very desirable and system- 
atizing supplement to what was expounded and explained using specific objects in 
the mandatory Chaps. 11-14. 

The section on series and integrals depending on a parameter gives, along with 
the traditional material, some elementary information on asymptotic series and 
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asymptotics of integrals (Chap. 19), since, due to its effectiveness, the latter is an 
unquestionably useful piece of analytic machinery. 

For convenience in orientation, ancillary material or sections that may be omitted 
on a first reading, are starred. 

The numbering of the chapters and figures in this book continues the numbering 
of the first part. 

Biographical information is given here only for those scholars not mentioned in 
the first part. 

As before, for the convenience of the reader, and to shorten the text, the end of a 
proof is denoted by LI. Where convenient, definitions are introduced by the special 
symbols := or =: (equality by definition), in which the colon stands on the side of 
the object being defined. 

Continuing the tradition of Part 1, a great deal of attention has been paid to both 
the lucidity and logical clarity of the mathematical constructions themselves and the 
demonstration of substantive applications in natural science for the theory devel- 
oped. 


Moscow, Russia V. Zorich 
1982 
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Chapter 9 
*Continuous Mappings (General Theory) 


In this chapter we shall generalize the properties of continuous mappings established 
earlier for numerical-valued functions and mappings of the type f : R” — R” and 
discuss them from a unified point of view. In the process we shall introduce a number 
of simple, yet important concepts that are used everywhere in mathematics. 


9.1 Metric Spaces 


9.1.1 Definition and Examples 


Definition 1 A set X is said to be endowed with a metric or a metric space structure 
or to be a metric space if a function 


d:XxxX—-R (9.1) 


is exhibited satisfying the following conditions: 


a) d(x1, x2) =0S x1 = x2, 
b) d(x1, x2) = d(x, x1) (symmetry), 
c) d(x1, x3) < d(x1, x2) + d(x2, x3) (the triangle inequality), 


where x1, x2, x3 are arbitrary elements of X. 


In that case, the function (9.1) is called a metric or distance on X. 

Thus a metric space is a pair (X, d) consisting of a set X and a metric defined on 
it. 

In accordance with geometric terminology the elements of X are called points. 

We remark that if we set x3 = x; in the triangle inequality and take account of 
conditions a) and b) in the definition of a metric, we find that 


0<d(x1, x2), 
that is, a distance satisfying axioms a), b), and c) is nonnegative. 
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Let us now consider some examples. 


Example I The set R of real numbers becomes a metric space if we set d(x1, x2) = 
|x2 — x;| for any two numbers x; and x2, as we have always done. 


Example 2 Other metrics can also be introduced on R. A trivial metric, for example, 
is the discrete metric in which the distance between any two distinct points is 1. 

The following metric on R is much more substantive. Let x > f(x) be a nonneg- 
ative function defined for x > 0 and vanishing for x = 0. If this function is strictly 
convex upward, then, setting 


d(x1, x2) = f ([x1 — xal) (9.2) 


for points x1, x2 € R, we obtain a metric on R. 

Axioms a) and b) obviously hold here, and the triangle inequality follows from 
the easily verified fact that f is strictly monotonic and satisfies the following in- 
equalities for0 <a <b: 


fat+b)— fo)<f@-fO=f@. 


In particular, one could set d(x1, x2) = J/|x1 — x2| or d(x1, x2) = mimx2l_ Ty 


1+|x1—x2|° 
the latter case the distance between any two points of the line is less than 1. 


Example 3 Besides the traditional distance 


n 
d(x1,x2) = xe _ a (9.3) 


i=1 


between points xj = Gt weep) and x2 = eee ..., x5) in IR”, one can also intro- 
duce the distance 


n I/p 
dp (x1, x2) = (S21 -!) (9.4) 


i=l 


where p > |. The validity of the triangle inequality for the function (9.4) follows 
from Minkowski’s inequality (see Sect. 5.4.2). 


Example 4 When we encounter a word with incorrect letters while reading a text, 
we can reconstruct the word without too much trouble by correcting the errors, 
provided the number of errors is not too large. However, correcting the error and 
obtaining the word is an operation that is sometimes ambiguous. For that reason, 
other conditions being equal, one must give preference to the interpretation of the 
incorrect text that requires the fewest corrections. Accordingly, in coding theory 
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the metric (9.4) with p = | is used on the set of all finite sequences of length n 
consisting of zeros and ones. 

Geometrically the set of such sequences can be interpreted as the set of ver- 
tices of the unit cube J = {x € R” |0<x' <1, i=1,...,n} in R”. The distance 
between two vertices is the number of interchanges of zeros and ones needed to 
obtain the coordinates of one vertex from the other. Each such interchange repre- 
sents a passage along one edge of the cube. Thus this distance is the shortest path 
along the edges of the cube from one of the vertices under consideration to the 
other. 


Example 5 In comparing the results of two series of nm measurements of the same 
quantity the metric most commonly used is (9.4) with p = 2. The distance between 
points in this metric is usually called their mean-square deviation. 


Example 6 As one can easily see, if we pass to the limit in (9.4) as p — +00, we 
obtain the following metric in R”: 


d(x1,x2) = max |x} _ i | (9.5) 


Example 7 The set C[a,b] of functions that are continuous on a closed interval 
becomes a metric space if we define the distance between two functions f and g to 
be 


d(f,g) = max | f(x) — g(x]. (9.6) 


Axioms a) and b) for a metric obviously hold, and the triangle inequality follows 
from the relations 


| f(x) —h(x)| <|f&) — g@)|+|g@) —A@)| <d(f.g) +d(g,h), 
that is, 
d(f,h)= max | f(x) —h()| <d(f, 8) +d(g,h). 


The metric (9.6) — the so-called uniform or Chebyshev metric in C[a, b] — is 
used when we wish to replace one function by another (for example, a polynomial) 
from which it is possible to compute the values of the first with a required degree of 
precision at any point x € [a, b]. The quantity d(f, g) is precisely a characterization 
of the precision of such an approximate computation. 

The metric (9.6) closely resembles the metric (9.5) in R”. 


Example § Like the metric (9.4), for p > 1 we can introduce in C[a, b] the metric 


b 1/p 
an(f.e)=( f— si?) dr) (0.7) 
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It follows from Minkowski’s inequality for integrals, which can be obtained from 
Minkowski’s inequality for the Riemann sums by passing to the limit, that this is 
indeed a metric for p > 1. 

The following special cases of the metric (9.7) are especially important: p = 1, 
which is the integral metric; p = 2, the metric of mean-square deviation; and p = 
+oo, the uniform metric. 

The space C[a, b] endowed with the metric (9.7) is often denoted C,[a, b]. One 
can verify that C..[a, b] is the space C[a, b] endowed with the metric (9.6). 


Example 9 The metric (9.7) could also have been used on the set R[a,b] of 
Riemann-integrable functions on the closed interval [a, b]. However, since the inte- 
gral of the absolute value of the difference of two functions may vanish even when 
the two functions are not identically equal, axiom a) will not hold in this case. Nev- 
ertheless, we know that the integral of a nonnegative function g € F[a, b] equals 
zero if and only if g(x) = 0 at almost all points of the closed interval [a, b]. 

Therefore, if we partition ?[a, b] into equivalence classes of functions, regarding 
two functions in 7[a, b] as equivalent if they differ on at most a set of measure zero, 
then the relation (9.7) really does define a metric on the set Ria, b] of such equiv- 
alence classes. The set Ria, b| endowed with this metric will be denoted Rs [a, b] 
and sometimes simply by 7¢p[a, b]. 


Example 10 In the set C “) ta, b] of functions defined on [a, b] and having continu- 
ous derivatives up to order k inclusive one can define the following metric: 


d(f, g) =max{Mo,..., Mx}, (9.8) 


where 


M; = max |f(x)—g()|, i=0,1,...,k. 
a<x<b 

Using the fact that (9.6) is a metric, one can easily verify that (9.8) is also a 
metric. 

Assume for example that f is the coordinate of a moving point considered 
as a function of time. If a restriction is placed on the allowable region where 
the point can be during the time interval [a,b] and the particle is not allowed 
to exceed a certain speed, and, in addition, we wish to have some assurance 
that the accelerations cannot exceed a certain level, it is natural to consider the 
set {maxg<y<p | f (x)|, Maxg<y<p | f’(x)|, Maxg<x<p | f’(x)|} for a function f € 
Ca, b] and using these characteristics, to regard two motions f and g as close 
together if the quantity (9.8) for them is small. 


These examples show that a given set can be metrized in various ways. The 
choice of the metric to be introduced is usually controlled by the statement of the 
problem. At present we shall be interested in the most general properties of metric 
spaces, the properties that are inherent in all of them. 
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9.1.2 Open and Closed Subsets of a Metric Space 


Let (X, d) be a metric space. In the general case, as was done for the case X = R” 
in Sect. 7.1, one can also introduce the concept of a ball with center at a given point, 
open set, closed set, neighborhood of a point, limit point of a set, and so forth. 

Let us now recall these concepts, which are basic for what is to follow. 


Definition 2 For 6 > 0 anda € X the set 
B(a,5) = {x € X | d(a,x) <8} 
is called the ball with center a € X of radius 6 or the 5-neighborhood of the point a. 


This name is a convenient one in a general metric space, but it must not be iden- 
tified with the traditional geometric image we are familiar with in R?. 


Example 11 The unit ball in C[a, b] with center at the function that is identically 0 
on [a, b] consists of the functions that are continuous on the closed interval [a, b] 
and whose absolute values are less than | on that interval. 


Example 12 Let X be the unit square in R? for which the distance between two 
points is defined to be the distance between those same points in R*. Then X is a 
metric space, while the square X considered as a metric space in its own right can 
be regarded as the ball of any radius p > /2/2 about its center. 


It is clear that in this way one could construct balls of very peculiar shape. Hence 
the term ball should not be understood too literally. 


Definition 3 A set G C X is open in the metric space (X, d) if for each point x € G 
there exists a ball B(x, 5) such that B(x, 5) CG. 


It obviously follows from this definition that X itself is an open set in (X,d). 
The empty set @ is also open. By the same reasoning as in the case of R” one can 
prove that a ball B(a,r) and its exterior {x € X: d(a,x) > r} are open sets. (See 
Examples 3 and 4 of Sect. 7.1.) 


Definition 4 A set F C X is closed in (X,d) if its complement X\F' is open in 
(X,d). 
In particular, we conclude from this definition that the closed ball 


B(a,r):= {x €X |d(a,x) <r} 


is a closed set in a metric space (X, d). 
The following proposition holds for open and closed sets in a metric space (X, d). 
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Proposition 1 a) The union |),<4 Gu of the sets in any system {Gy,a € A} of sets 
Gy, that are open in X is an open set in X. 

b) The intersection (\_, Gi of any finite number of sets that are open in X is an 
open set in X. 

a’) The intersection (\ye4 Fa of the sets in any system {Fy,a € A} of sets Fy 
that are closed in X is a closed set in X. 

b’) The union \_}_, Fj of any finite number of sets that are closed in X is a closed 
setin X. 


The proof of Proposition | is a verbatim repetition of the proof of the correspond- 
ing proposition for open and closed sets in IR”, and we omit it. (See Proposition 1 in 
Sect. 7.1.) 


Definition 5 An open set in X containing the point x € X is called a neighborhood 
of the point x in X. 


Definition 6 Relative to a set E C X, a point x € X is called 


an interior point of E if some neighborhood of it is contained in X, 

an exterior point of E if some neighborhood of it is contained in the complement 
of E in X, 

a boundary point of E if it is neither interior nor exterior to E (that is, every 
neighborhood of the point contains both a point belonging to E and a point not 
belonging to E). 


Example 13 All points of a ball B(a,r) are interior to it, and the set Cx B (a,r)= 
XxX \B (a,r) consists of the points exterior to the ball B(a,r). 

In the case of R” with the standard metric d the sphere S(a,r) := {x € R” | 
d(a, x) =r => O} is the set of boundary points of the ball B(a, r). 


Definition 7 A point a € X is a limit point of the set E C X if the set EM O(a) is 
infinite for every neighborhood O(a) of the point. 


Definition 8 The union of the set E and the set of all its limit points is called the 
closure of the set E in X. 
As before, the closure of a set E C X will be denoted E. 


Proposition 2 A set F Cc X is closed in X if and only if it contains all its limit 
points. 


Thus 
(F is closed in X) <> (F = F in X). 


‘In connection with Example 13 see also Problem 2 at the end of this section. 
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We omit the proof, since it repeats the proof of the analogous proposition for the 
case X = R” discussed in Sect. 7.1. 


9.1.3 Subspaces of a Metric Space 


If (X, d) is a metric space and E is a subset of X, then, setting the distance between 
two points x; and x2 of E equal to d(x), x2), that is, the distance between them 
in X, we obtain the metric space (EF, d), which is customarily called a subspace of 
the original space (X, d). 

Thus we adopt the following definition. 


Definition 9 A metric space (X1, d1) is a subspace of the metric space (X,d) if 
X, CX and the equality d; (a, b) = d(a, b) holds for any pair of points a, b in Xj. 

Since the ball By(a,r) = {x € X, | di (a,x) <r} in a subspace (Xj, d1) of the 
metric space (X, d) is obviously the intersection 


Byi(a,r) = X1N B(a,r) 
of the set X; C X with the ball B(a,r) in X, it follows that every open set in X 
has the form 
Gi =X,NG, 


where G is an open set in X, and every closed set F; in X, has the form 
Fi, =X, NF, 


where F is a closed set in X. 

It follows from what has just been said that the properties of a set in a metric 
space of being open or closed are relative properties and depend on the ambient 
space. 


Example 14 The open interval |x| < 1, y =0 of the x-axis in the plane R? with the 
standard metric in R? is a metric space (X1,d,), which, like any metric space, is 
closed as a subset of itself, since it contains all its limit points in X;. At the same 
time, it is obviously not closed in R? = X. 


This same example shows that openness is also a relative concept. 


Example 15 The set C[a, b] of continuous functions on the closed interval [a, b] 
with the metric (9.7) is a subspace of the metric space R.p[a, b]. However, if we 
consider the metric (9.6) on C[a, b] rather than (9.7), this is no longer true. 
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9.1.4 The Direct Product of Metric Spaces 


If (X 1, d1) and (X2, dz) are two metric spaces, one can introduce a metric d on the 
direct product X; x X2. The commonest methods of introducing a metric in Xj x X2 
are the following. If (x, x2) € X1 x Xz and (x, x4) € X; x X2, one may set 


d( (1,2), (21,45) = a? (x1,x}) +43 (02,24), 
or 
d((x1,%2), (x4, x5)) =d (x1, x4) + d2(x2, x5), 


or 
d((x1, x2), (x} F x5)) — max{d (x1, x5), dy (x2, 5) js 


It is easy to see that we obtain a metric on X; x X2 in all of these cases. 


Definition 10 if (X,,d,) and (X2,d2) are two metric spaces, the space (X1 x 
X2,d), where d is a metric on X; x X2 introduced by any of the methods just 
indicated, will be called the direct product of the original metric spaces. 


Example 16 The space IR? can be regarded as the direct product of two copies of 
the metric space R with its standard metric, and R? is the direct product R* x R! of 
the spaces R* and R! =R. 


9.1.5 Problems and Exercises 


1. a) Extending Example 2, show that if f : RR, — Rx is a continuous function 
that is strictly convex upward and satisfies f (0) = 0, while (X, d) is a metric space, 
then one can introduce a new metric dy on X by setting ds (x1, x2) = f(d(1, X2)). 

b) Show that on any metric space (X, d) one can introduce a metric d' (x1, x2) = 


401.2) in which the distance between the points will be less than 1. 
1+d(x1,x2) 


2. Let (X,d) be a metric space with the trivial (discrete) metric shown in Ex- 
ample 2, and let a € X. For this case, what are the sets B(a,1/2), B(a, 1), 
B(a, 1), B(a, 1), Bla, 3/2), and what are the sets {x € X | d(a, x) = 1/2}, {x € X | 
d(a, x) = 1}, B(a, 1)\B(a, 1), B(a, 1)\B(a, 1)? 
3. a) Is it true that the union of any family of closed sets is a closed set? 

b) Is every boundary point of a set a limit point of that set? 

c) Is it true that in any neighborhood of a boundary point of a set there are points 
in both the interior and exterior of that set? 

d) Show that the set of boundary points of any set is a closed set. 


4. a) Prove that if (Y, dy) is a subspace of the metric space (X, dy), then for any 
open (resp. closed) set Gy (resp. Fy) in Y there is an open (resp. closed) set Gx 
(resp. Fx) in X such that Gy = Y NGy, (resp. Fy = YN Fy). 
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b) Verify that if the open sets G/, and G}, in Y do not intersect, then the corre- 
sponding sets Gy and G, in X can be chosen so that they also have no points in 
common. 


5. Having a metric d on a set X, one may attempt to define the distance d(A, B) 
between sets A C X and B C X as follows: 


d(A, B)=_ inf b). 
d(A, B) ge ) 


a) Give an example of a metric space and two nonintersecting subsets of it A 
and B for which d(A, B) = 0. 

b) Show, following Hausdorff, that on the set of closed sets of a metric space 
(X, d) one can introduce the Hausdorff metric D by assuming that for A Cc X and 
BCX 


D(A, B):= max{ sup d(a, B), sup d(A, b). 
acA beB 


9.2 Topological Spaces 


For questions connected with the concept of the limit of a function or a mapping, 
what is essential in many cases is not the presence of any particular metric on the 
space, but rather the possibility of saying what a neighborhood of a point is. To 
convince oneself of that it suffices to recall that the very definition of a limit or the 
definition of continuity can be stated in terms of neighborhoods. Topological spaces 
are the mathematical objects on which the operation of passage to the limit and the 
concept of continuity can be studied in maximum generality. 


9.2.1 Basic Definitions 


Definition 1 A set X is said to be endowed with the structure of a topological space 
or a topology or is said to be a topological space if a system t of subsets of X is 
exhibited (called open sets in X) possessing the following properties: 


a) @et; X ET. 
b) (Va € A(t €T)) => Upea Ta €T. 
Oiget t= lc.) eet: 


Thus, a topological space is a pair (X, T) consisting of a set X and a system T 
of distinguished subsets of the set having the properties that t contains the empty 
set and the whole set X, the union of any number of sets of tT is a set of tT, and the 
intersection of any finite number of sets of tT is a set of T. 

As one can see, in the axiom system a), b), c) for a topological space we have 
postulated precisely the properties of open sets that we already proved in the case of 
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a metric space. Thus any metric space with the definition of open sets given above 
is a topological space. 

Thus defining a topology on X means exhibiting a system Tt of subsets of X 
satisfying the axioms a), b), and c) for a topological space. 

Defining a metric in X, as we have seen, automatically defines the topology on X 
induced by that metric. It should be remarked, however, that different metrics on X 
may generate the same topology on that set. 


Example I Let X = R” (n > 1). Consider the metric d (x1, x2) defined by relation 
(9.5) in Sect. 9.1, and the metric d2(x1, x2) defined by formula (9.3) in Sect. 9.1. 
The inequalities 


dy (x1,.x2) < do(x1, x2) < Jndi (x1, x2), 


obviously imply that every ball B(a,r) with center at an arbitrary point a € X, 
interpreted in the sense of one of these two metrics, contains a ball with the same 
center, interpreted in the sense of the other metric. Hence by definition of an open 
subset of a metric space, it follows that the two metrics induce the same topology 
on X. 


Nearly all the topological spaces that we shall make active use of in this course 
are metric spaces. One should not think, however, that every topological space can 
be metrized, that is, endowed with a metric whose open sets will be the same as 
the open sets in the system Tt that defines the topology on X. The conditions under 
which this can be done form the content of the so-called metrization theorems. 


Definition 2 If (X, tT) is a topological space, the sets of the system t are called the 
open sets, and their complements in X are called the closed sets of the topological 
space (X,T). 

A topology t on a set X is seldom defined by enumerating all the sets in the 
system t. More often the system t is defined by exhibiting only a certain set of 
subsets of X from which one can obtain any set in the system t through union and 
intersection. The following definition is therefore very important. 


Definition 3 A base of the topological space (X,t) (an open base or base for the 
topology) is a family 5 of open subsets of X such that every open set G € T is the 
union of some collection of elements of the family 8. 


Example 2 If (X,d) is a metric space and (x, t) the topological space correspond- 
ing to it, the set 8 = {B(a,r)} of all balls, where a € X and r > 0, is obviously a 
base of the topology t. Moreover, if we take the system 9% of all balls with positive 
rational radii r, this system is also a base for the topology. 


Thus a topology can be defined by describing only a base of that topology. As 
one can see from Example 2, a topological space may have many different bases for 
the topology. 
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Definition 4 The minimal cardinality among all bases of a topological space is 
called its weight. 


As atule, we shall be dealing with topological spaces whose topologies admit a 
countable base (see, however, Problems 4 and 6). 


Example 3 If we take the system 9% of balls in R* of all possible rational radii r = 
* > 0 with centers at all possible rational points ee or ae) € R*, we obviously 
obtain a countable base for the standard topology of R. It is not difficult to verify 
that it is impossible to define the standard topology in R* by exhibiting a finite 


system of open sets. Thus the standard topological space R* has countable weight. 


Definition 5 A neighborhood of a point of a topological space (X, T) is an open set 
containing the point. 

It is clear that if a topology t is defined on X, then for each point the system of 
its neighborhoods is defined. 

It is also clear that the system of all neighborhoods of all possible points of 
topological space can serve as a base for the topology of that space. Thus a topology 
can be introduced on X by describing the neighborhoods of the points of X. This is 
the way of defining the topology in X that was originally used in the definition of a 
topological space.” Notice, for example, that we have introduced the topology in a 
metric space itself essentially by saying what a 5-neighborhood of a point is. Let us 
give one more example. 


Example 4 Consider the set C(R, R) of real-valued continuous functions defined 
on the entire real line. Using this set as foundation, we shall construct a new set 
— the set of germs of continuous functions. We shall regard two functions f, g € 
C(R, R) as equivalent at the point a € R if there is a neighborhood U (a) of that 
point such that Vx € U(a) (f (x) = g(x)). The relation just introduced really is an 
equivalence relation (it is reflexive, symmetric, and transitive). An equivalence class 
of continuous functions at the point a € R is called germ of continuous function at 
that point. If f is one of the functions generating the germ at the point a, we shall 
denote the germ itself by the symbol f,. Now let us define a neighborhood of a 
germ. Let U(a) be a neighborhood of the point a and f a function defined on U (a) 
generating the germ f, at a. This same function generates its germ f; at any point 
x € U(a). The set {f,} of all germs corresponding to the points x € U(a) will be 
called a neighborhood of the germ fz. Taking the set of such neighborhoods of all 
germs as the base of a topology, we turn the set of germs of continuous functions 
into a topological space. It is worthwhile to note that in the resulting topological 


The concepts of a metric space and a topological space were explicitly stated early in the twen- 
tieth century. In 1906 the French mathematician M. Fréchet (1878-1973) introduced the concept 
of a metric space, and in 1914 the German mathematician F. Hausdorff (1868-1942) defined a 
topological space. 
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Fig. 9.1 f 


space two different points (germs) f, and g, may not have disjoint neighborhoods 
(see Fig. 9.1). 


Definition 6 A topological space is Hausdorff if the Hausdorff axiom holds in it: 
any two distinct points of the space have nonintersecting neighborhoods. 


Example 5 Any metric space is obviously Hausdorff, since for any two points 
a,b € X such that d(a,b) > 0 their spherical neighborhoods B(a, 5d(a, b)), 
Bib, laa, b)) have no points in common. 

At the same time, as Example 4 shows, there do exist non-Hausdorff topological 
spaces. Perhaps the simplest example here is the topological space (X, tT) with the 
trivial topology t = {@, X}. If X contains at least two distinct points, then (X, T) is 
obviously not Hausdorff. Moreover, the complement X\x of a point in this space is 
not an open set. 

We shall be working exclusively with Hausdorff spaces. 


Definition 7 A set E C X is (everywhere) dense in a topological space (X, T) if 
for any point x € X and any neighborhood U (x) of it the intersection E 1 U(X) is 
nonempty. 


Example 6 If we consider the standard topology in R, the set Q of rational numbers 
is everywhere dense in R. Similarly the set Q” of rational points in R” is dense 
in R”. 


One can show that in every topological space there is an everywhere dense set 
whose cardinality does not exceed the weight of the topological space. 


Definition 8 A metric space having a countable dense set is called a separable 
space. 


Example 7 The metric space (IR”, d) in any of the standard metrics is a separable 
space, since Q” is dense in it. 


Example 8 The metric space (C([0, 1], .R),d) with the metric defined by (9.6) 
is also separable. For, as follows from the uniform continuity of the functions 
f €C((0, 1], R), the graph of any such function can be approximated as closely 
as desired by a broken line consisting of a finite number of segments whose nodes 
have rational coordinates. The set of such broken lines is countable. 
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We shall be dealing mainly with separable spaces. 

We now remark that, since the definition of a neighborhood of a point in a topo- 
logical space is verbally the same as the definition of a neighborhood of a point in 
a metric space, the concepts of interior point, exterior point, boundary point, and 
limit point of a set, and the concept of the closure of a set, all of which use only the 
concept of a neighborhood, can be carried over without any changes to the case of 
an arbitrary topological space. 

Moreover, as can be seen from the proof of Proposition 2 in Sect. 7.1, it is also 
true that a set in a Hausdorff space is closed if and only if it contains all its limit 
points. 


9.2.2 Subspaces of a Topological Space 


Let (X, Tx) be a topological space and Y a subset of X. The topology tx makes 
it possible to define the following topology ty in Y, called the induced or relative 
topology on Y Cc X. 

We define an open set in Y to be any set Gy of the form Gy = YM Gx, where 
Gy is an open set in X. 

It is not difficult to verify that the system ty of subsets of Y that arises in this 
way satisfies the axioms for open sets in a topological space. 

As one can see, the definition of open sets Gy in Y agrees with the one we 
obtained in Sect. 9.1.3 for the case when Y is a subspace of a metric space X. 


Definition 9 A subset Y C X of a topological space (X, 1) with the topology ty 
induced on Y¥ is called a subspace of the topological space X. 
It is clear that a set that is open in (Y, ty) is not necessarily open in (X, Tx). 


9.2.3 The Direct Product of Topological Spaces 


If (X1, ™|)) and (X2, T2) are two topological spaces with systems of open sets Tt] = 
{G,} and tz = {G2}, we can introduce a topology on X1 x X2 by taking as the base 
the sets of the form G, x Go. 


Definition 10 The topological space (X1 x X2, 71 x 12) whose topology has the 
base consisting of sets of the form G; x G2, where G; is an open set in the topo- 
logical space (Xj, tT), i = 1, 2, is called the direct product of the topological spaces 
(X1, T%)) and (X2, 72). 


Example 9 If R = R! and R? are considered with their standard topologies, then, 
as one can see, R? is the direct product R! x R!. For every open set in R* can be 
obtained, for example, as the union of “square” neighborhoods of all its points. And 
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squares (with sides parallel to the axes) are the products of open intervals, which are 
open sets in R. 

It should be noted that the sets Gj x G2, where G, € Tt; and Go € 72, constitute 
only a base for the topology, not all the open sets in the direct product of topological 
spaces. 


9.2.4 Problems and Exercises 


1. Verify that if (X, d) is a metric space, then (X, 74) is also a metric space, and 


the metrics d and ro induce the same topology on X. (See also Problem | of the 
preceding section.) 
2. a) In the set N of natural numbers we define a neighborhood of the number 
n €N to be an arithmetic progression with difference d relatively prime to n. Is the 
resulting topological space Hausdorff? 

b) What is the topology of N, regarded as a subset of the set R of real numbers 
with the standard topology? 


c) Describe all open subsets of R. 


3. If two topologies t; and t2 are defined on the same set, we say that T2 is stronger 
than tT, if tT, C T, that is t2 contains all the sets in tT; and some additional open sets 
not in Ty. 


a) Are the two topologies on N considered in the preceding problem compara- 
ble? 

b) If we introduce a metric on the set C[0, 1] of continuous real-valued functions 
defined on the closed interval [0, 1] first by relation (9.6) of Sect. 9.1, and then by 
relation (9.7) of the same section, two topologies generally arise on C[a, b]. Are 
they comparable? 


4. a) Prove in detail that the space of germs of continuous functions defined in 
Example 4 is not Hausdorff. 

b) Explain why this topological space is not metrizable. 

c) What is the weight of this space? 


5. a) State the axioms for a topological space in the language of closed sets. 

b) Verify that the closure of the closure of a set equals the closure of the set. 

c) Verify that the boundary of any set is a closed set. 

d) Show that if F is closed and G is open in (X, T), then the set G\ F is open in 
(X, T). 

e) If (Y, ty) is a subspace of the topological space (X, tT), and the set E is such 
thatE CY CX and E € ty, then E € ty. 


6. A topological space (X, tT) in which every point is a closed set is called a topo- 
logical space in the strong sense or a T-Space. Verify the following statements. 


a) Every Hausdorff space is a t|-space (partly for this reason, Hausdorff spaces 
are sometimes called t2-spaces). 
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b) Not every t,-space is a tT2-space. (See Example 4.) 
c) The two-point space X = {a, b} with the open sets {@, X} is not a tT1-space. 
d) Ina t1-space a set F is closed if and only if it contains all its limit points. 


7. a) Prove that in any topological space there is an everywhere dense set whose 
cardinality does not exceed the weight of the space. 

b) Verify that the following metric spaces are separable: C[a, b], C ®)Ta, b], 
Rila, b], Rp[a, b] (for the formulas giving the respective metrics see Sect. 9.1). 

c) Verify that if max is replaced by sup in relation (9.6) of Sect. 9.1 and regarded 
as a metric on the set of all bounded real-valued functions defined on a closed inter- 
val [a, b], we obtain a nonseparable metric space. 


9.3 Compact Sets 


9.3.1 Definition and General Properties of Compact Sets 


Definition 1 A set K in a topological space (X, tT) is compact (or bicompact*) if 
from every covering of K by sets that are open in X one can select a finite number 
of sets that cover K. 


Example I An interval [a, b] of the set R of real numbers in the standard topology 
is a compact set, as follows immediately from the lemma of Sect. 2.1.3 asserting 
that one can select a finite covering from any covering of a closed interval by open 
intervals. 

In general an m-dimensional closed interval J” = {x € R”™ | ai<x'<bi,i=1, 
...,m} in R™ is a compact set, as was established in Sect. 7.1.3. 


It was also proved in Sect. 7.1.3 that a subset of R” is compact if and only if it 
is closed and bounded. 

In contrast to the relative properties of being open and closed, the property of 
compactness is absolute, in the sense that it is independent of the ambient space. 
More precisely, the following proposition holds. 


Proposition 1 A subset K of a topological space (X,t) is a compact subset of X if 
and only if K is compact as a subset of itself with the topology induced from (X, T). 


Proof This proposition follows from the definition of compactness and the fact that 
every set Gx that is open in K can be obtained as the intersection of K with some 
set Gy that is open in X. 


3The concept of compactness introduced by Definition 1 is sometimes called bicompactness in 
topology. 
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Thus, if (X, tx) and (Y, ty) are two topological spaces that induce the same 
topology on K Cc XY, then K is simultaneously compact or not compact in both 
X andY. 


Example 2 Let d be the standard metric on R and J = {x € R| 0 < x < 1} the unit 
interval in R. The metric space (J, d) is closed (in itself) and bounded, but is not a 
compact set, since for example, it is not a compact subset of R. 


We now establish the most important properties of compact sets. 


Lemma 1 (Compact sets are closed) If K is a compact set in a Hausdorff space 
(X, T), then K is aclosed subset of X. 


Proof By the criterion for a set to be closed, it suffices to verify that every limit 
point of K, xo € X, belongs to K. 

Suppose xq ¢ K. For each point x € K we construct an open neighborhood G(x) 
such that xo has a neighborhood disjoint from G(x). The set G(x), x € K, of all 
such neighborhoods forms an open covering of K, from which one can select a 
finite covering G(x1),..., G(%,). Now if O; (xo) is a neighborhood of xo such that 
G(x;) M O; (xo) = ©, the set O(x) = (ha O; (xo) is also a neighborhood of xo, and 
G(x;) N O(xo) = @ for all i =1,...,. But this means that K M O(xo) = @, and 
then xo cannot be a limit point for K. 


Lemma 2 (Nested compact sets) If K; D K2 D---D Kn D--- is anested sequence 
of nonempty compact sets, then the intersection (°°, Ki is nonempty. 


Proof By Lemma | the sets G; = K,\Kj,i=1,...,n,... are open in Kj. If the 
intersection (\?°, K; is empty, then the sequence Gj C G2 C---C G, C--- forms 
a covering of K,. Extracting a finite covering from it, we find that some element 
Gm of the sequence forms a covering of K;. But by hypothesis Ky, = Ki\Gm 4 2. 
This contradiction completes the proof of Lemma 2. 


Lemma 3 (Closed subsets of compact sets) A closed subset F of a compact set K 
is itself compact. 


Proof Let {G_,a € A} be an open covering of F’. Adjoining to this collection the 
open set G = K\F, we obtain an open covering of the entire compact set K. From 
this covering we can extract a finite covering of K. Since GN F = @, it follows that 
the set {Gy, a € A} contains a finite covering of F. 


9.3.2 Metric Compact Sets 


We shall establish below some properties of metric compact sets, that is, metric 
spaces that are compact sets with respect to the topology induced by the metric. 
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Definition 2 The set E Cc X is called an e-grid in the metric space (X, d) if for 
every point x € X there is a point e € E such that d(e, x) <«. 


Lemma 4 (Finite e-grids) [fa metric space (K, d) is compact, then for every ¢ > 0 
there exists a finite e-grids in X. 


Proof For each point x € K we choose an open ball B(x, ¢). From the open cover- 
ing of K by these balls we select a finite covering B(x), €),..., B(Xn, €). The points 
X1,...,X, obviously form the required e-grid. 


In analysis, besides arguments that involve the extraction of a finite covering, one 
often encounters arguments in which a convergent subsequence is extracted from an 
arbitrary sequence. As it happens, the following proposition holds. 


Proposition 2 (Criterion for compactness in a metric space) A metric space (K, d) 
is compact if and only if from each sequence of its points one can extract a subse- 
quence that converges to a point of K. 


The convergence of the sequence {x,} to some point a € K, as before, means 
that for every neighborhood U (a) of the point a € K there exists an index N € N 
such that x, € U(a) forn > N. 

We shall discuss the concept of limit in more detail below in Sect. 9.6. 

We preface the proof of Proposition 2 with two lemmas. 


Lemma 5 /f a metric space (K, d) is such that from each sequence of its points one 
can select a subsequence that converges in K, then for every ¢ > 0 there exists a 
finite €-grid. 


Proof If there were no finite eg-grid for some €9 > 0, one could construct a sequence 
{x,} of points in K such that d(x, x;) > €9 for alln € N and alli € {1,...,n— 1}. 
Obviously it is impossible to extract a convergent subsequence of this sequence. 


Lemma 6 /f the metric space (K,d) is such that from each sequence of its points 
one can select a subsequence that converges in K, then every nested sequence of 
nonempty closed subsets of the space has a nonempty intersection. 


Proof If F, D--:D Fy, D--- is the sequence of closed sets, then choosing one point 
of each, we obtain a sequence x1,...,Xn,..., from which we extract a convergent 
subsequence {x,,}. The limit a €¢ K of this sequence, by construction, necessarily 
belongs to each of the closed sets Fj, i € N. 


We can now prove Proposition 2. 


Proof We first verify that if (K,d) is compact and {x,} a sequence of points in 
it, one can extract a subsequence that converges to some point of K. If the se- 
quence {x,} has only a finite number of different values, the assertion is obvious. 


18 9 *Continuous Mappings (General Theory) 


Therefore we may assume that the sequence {x,} has infinitely many different val- 
ues. For ¢; = 1/1, we construct a finite 1-grid and take a closed ball Bay, 1) 
that contains an infinite number of terms of the sequence. By Lemma 3 the ball 
B (a1, 1) is itself a compact set, in which there exists a finite €2 = 1/2-grid and a 
ball Bian, 1/2) containing infinitely many elements of the sequence. In this way a 
nested sequence of compact sets B(a1, 1) D Bla, 1/2)D---D B(an, 1/n)D- 
arises, and by Lemma 2 has a common point a € K. ‘Choosing a point x,, of the 
sequence {x,} in the ball Bay, 1), then a point x, in B(ap, 1/2) with nz > n,, and 
so on, we obtain a subsequence {x,,,} that converges to a by construction. 

We now prove the converse, that is, we verify that if from every sequence {x,} of 
points of the metric space (K, d) one can select a subsequence that converges in K, 
then (K, d) is compact. 

In fact, if there is some open covering {Gy,a € A} of the space (K,d) from 
which one cannot select a finite covering, then using Lemma 5 to construct a finite 
1-grid in K, we find a closed ball B (a1, 1), that also cannot be covered by a finite 
collection of sets of the system {By, a € A}. 

The ball B (a1, 1) can now be regarded as the initial set, and, constructing a finite 
1/2-grid in it, we find in it a ball B (a2, 1/2) that does not admit covering by a finite 
number of sets in the system {Gy, a € A}. 

The resulting nested sequence of closed sets Bla, 1)>D Bla, 1/2)D---D 
B (a,,1/n) > --- has a common point a € K by Lemma 6, and the construction 
shows that there is only one such point. This point is covered by some set Gg, 
of the system; and since Gg, is open, all the sets B(an, 1/n) must be contained 
in Ga, for sufficiently large values of n. This contradiction completes the proof of 
the proposition. 


9.3.3 Problems and Exercises 


1. A subset of a metric space is totally bounded if for every ¢ > 0 it has a finite 
€-grid. 


a) Verify that total boundedness of a set is unaffected, whether one forms the 
grid from points of the set itself or from points of the ambient space. 

b) Show that a subset of a complete metric space is compact if and only if it is 
totally bounded and closed. 

c) Show by example that a closed bounded subset of a metric space is not always 
totally bounded, and hence not always compact. 


2. A subset of a topological space is relatively (or conditionally) compact if its 
closure is compact. 

Give examples of relatively compact subsets of R”. 
3. A topological space is locally compact if each point of the space has a relatively 
compact neighborhood. 

Give examples of locally compact topological spaces that are not compact. 
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4. Show that for every locally compact, but not compact topological space (X, Tx) 
there is a compact topological space (Y, ty) such that X C Y, Y\X consists of a 
single point, and the space (X, tx) is a subspace of the space (Y, ty). 


9.4 Connected Topological Spaces 


Definition 1 A topological space (X, T) is connected if it contains no open-closed 
sets* except X itself and the empty set. 


This definition will become more transparent to intuition if we recast it in the 
following form. 

A topological space is connected if and only if it cannot be represented as the 
union of two disjoint nonempty closed sets (or two disjoint nonempty open sets). 


Definition 2 A set E in a topological space (X, tT) is connected if it is connected as 
a topological subspace of (X, T) (with the induced topology). 


It follows from this definition and Definition | that the property of a set of be- 
ing connected is independent of the ambient space. More precisely, if (X, tx) and 
(Y, ty) are topological spaces containing E and inducing the same topology on EF, 
then E is connected or not connected simultaneously in both X and Y. 


Example I Let E = {x € R| x #0}. The set E_ = {x € E | x < 0} is nonempty, 
not equal to E, and at the same time open-closed in E (as is Ey = {x € R| x > 0}), 
if E is regarded as a topological space with the topology induced by the standard 
topology of R. Thus, as our intuition suggests, E is not connected. 


Proposition (Connected subsets of R) A nonempty set E C R is connected if and 
only if for any x and z belonging to E, the inequalities x < y < z imply that y € E. 


Thus, the only connected subsets of the line are intervals (finite or infinite): open, 
half-open, and closed. 


Proof Necessity. Let E be a connected subset of R, and let the triple of points a, b, c 
be such that a € E, be E, but c ¢ E, even though a <c <b. Setting A= {xe E | 
x <c},B={xeE|x>c}, we see thataec A, be B, thatis, AAO, BAG, 
and AM B = ©. Moreover E = A U B, and both sets A and B are open in E. This 
contradicts the connectedness of EF. 


Sufficiency. Let E be a subspace of R having the property that together with any pair 
of points a and b belonging to it, every point between them in the closed interval 
[a, b] also belongs to E. We shall show that F is connected. 


4That is, sets that are simultaneously open and closed. 
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Suppose that A is an open-closed subset of E with A# @ and B= E\AF@. 
Let a € A and b € B. For definiteness we shall assume that a < b. (We certainly 
have a 4 b, since AM B = @.) Consider the point c; = sup{A MN [a, b]}. Since A 5 
a<cy <beB, we have c; € E. Since A is closed in E, we conclude that c; € A. 

Considering now the point cz = inf{B M [c1, b]} we conclude similarly, since B 
is closed, that cp € B. Thus a < cy < co <b, since cy € A,co € Band AN B=2@. 
But it now follows from the definition of cy and cz and the relation E = A U B that 
no point of the open interval ]c;, c2[ can belong to E. This contradicts the original 
property of E. Thus the set E cannot have a subset A with these properties, and that 
proves that E is connected. 


9.4.1 Problems and Exercises 


1. a) Verify that if A is an open-closed subset of (X, Tt), then B = X\A is also such 
a set. 

b) Show that in terms of the ambient space the property of connectedness of a set 
can be expressed as follows: A subset E of a topological space (X,t) is connected 
if and only if there is no pair of open (or closed) subsets G',, G'y, that are disjoint 
and such that EN GY #9, ENG, #@,and EC GY UG. 


2. Show the following: 


a) The union of connected subspaces having a common point is connected. 
b) The intersection of connected subspaces is not always connected. 
c) The closure of a connected subspace is connected. 


3. One can regard the group GL(n) of nonsingular n x n matrices with real entries as 
an open subset in the product space R” , if each element of the matrix is associated 
with a copy of the set R of real numbers. Is the space GL(n) connected? 

4. A topological space is locally connected if each of its points has a connected 
neighborhood. 


a) Show that a locally connected space may fail to be connected. 

b) The set E in R? consists of the graph of the function x > sin + (for x #0) 
plus the closed interval {(x, y) € R* |x =0A |y| < 1} on the y-axis. The set E is 
endowed with the topology induced from R?. Show that the resulting topological 
space is connected but not locally connected. 


5. In Sect. 7.2.2 we defined a connected subset of IR” as a set E C R” any two 
of whose points can be joined by a path whose support lies in E. In contrast to 
the definition of topological connectedness introduced in the present section, the 
concept we considered in Chap. 7 is usually called path connectedness or arcwise 
connectedness. Verify the following: 


a) A path-connected subset of R” is connected. 
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b) Not every connected subset of IR” with n > 1 is path connected. (See Prob- 
lem 4.) 
c) Every connected open subset of R” is path connected. 


9.5 Complete Metric Spaces 


In this section we shall be discussing only metric spaces, more precisely, a class of 
such spaces that plays an important role in various areas of analysis. 


9.5.1 Basic Definitions and Examples 


By analogy with the concepts that we already know from our study of the space R”, 
we introduce the concepts of fundamental (Cauchy) sequences and convergent se- 
quences of points of an arbitrary metric space. 


Definition 1 A sequence {x,;n € N} of points of a metric space (X, d) is a fun- 
damental or Cauchy sequence if for every ¢ > O there exists N € N such that 
d(Xm, Xn) < € for any indices m,n € N larger than N. 


Definition 2 A sequence {x,;n € N} of points of a metric space (X, d) converges 
to the point a € X and a is its limit if limp—+ood(a, x) = 0. 


A sequence that has a limit will be called convergent, as before. 
We now give the basic definition. 


Definition 3 A metric space (X,d) is complete if every Cauchy sequence of its 
points is convergent. 


Example I The set R of real numbers with the standard metric is a complete met- 
ric space, as follows from the Cauchy criterion for convergence of a numerical se- 
quence. 


We remark that, since every convergent sequence of points in a metric space is 
obviously a Cauchy sequence, the definition of a complete metric space essentially 
amounts to simply postulating the Cauchy convergence criterion for it. 


Example 2 If the number 0, for example, is removed from the set R, the remaining 
set R\O will not be a complete space in the standard metric. Indeed, the sequence 
Xn = 1/n,n €N, is a Cauchy sequence of points of this set, but has no limit in R\0. 


Example 3 The space R” with any of its standard metrics is complete, as was ex- 
plained in Sect. 7.2.1. 
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Example 4 Consider the set C[a, b] of real-valued continuous functions on a closed 
interval [a, b] C R, with the metric 


d(f,g) = max | f(x) — g(x)| (9.9) 
a<x<b 
(see Sect. 9.1, Example 7). We shall show that the metric space C[a, b] is complete. 


Proof Let { fn(x): n € N} be a Cauchy sequence of functions in C[a, b], that is 


Ve >04N ENVmeNVneN((m>NAn>N)=> 
==> Vx € [a,b] (| fine) — fn(x)| <e)). (9.10) 


For each fixed value of x € [a,b], as one can see from (9.10), the numerical 
sequence { fn (x); € N} is a Cauchy sequence and hence has a limit f(x) by the 
Cauchy convergence criterion. 

Thus 


f(x):= lim ful), x € [a,b]. (9.11) 


We shall verify that the function f(x) is continuous on [a, b], thatis, f € Cla, Db]. 
It follows from (9.10) and (9.11) that the inequality 


| f(x) — fa(x)|<e Vx € [a,b] (9.12) 


holds forn > N. 
We fix the point x € [a, b] and verify that the function f is continuous at this 
point. Suppose the increment h is such that (x + h) € [a, b]. The identity 


fx +h)— f@)=fath)— fra th) t fale +h) — fal®) + fae) — FO) 
implies the inequality 


|f@ +A) — f@)|<|f@+h)- fra@+h|+ 
+ | fale +h) = fn(®)| + | fn) — f@)|. (9.13) 


By virtue of (9.12) the first and last terms on the right-hand side of this last 
inequality do not exceed ¢ if n > N. Fixing n > N, we obtain a function fh, € 
C[a, b], and then choosing 6 = 5(€) such that | f, (x +h) — fn(x)| < e for |h| <4, 
we find that | f(x +h) — f(x)| < 3e if |h| <6. But this means that the function f 
is continuous at the point x. Since x was an arbitrary point of the closed interval 
[a, b], we have shown that f € C[a, b]. 


Thus the space C[a, b] with the metric (9.9) is a complete metric space. This is 
a very important fact, one that is widely used in analysis. 
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Fig. 9.2 


Example 5 If instead of the metric (9.9) we consider the integral metric 


b 
d(f.g)= / Lf — gl(x) dx (9.14) 


on the same set C[a, b], the resulting metric space is no longer complete. 


Proof For the sake of notational simplicity, we shall assume [a, b] = [—1, 1] and 
consider, for example, the sequence { fj, € C[—1, 1]; n € N} of functions defined as 
follows: 


1). 4 AtSee— 1, 
fax) =4nx, if —1/n<x<I1/n, 
1, ifl/n<x<1. 


(See Fig. 9.2.) 

It follows immediately from properties of the integral that this sequence is a 
Cauchy sequence in the sense of the metric (9.14) in C[—1, 1]. At the same time, it 
has no limit in C[—1, 1]. For if a continuous function f € C[—1, 1] were the limit 
of this sequence in the sense of metric (9.14), then f would have to be constant on 
the interval —1 < x <0 and equal to —1 while at the same time it would have to be 
constant and equal to | on the interval 0 < x < 1, which is incompatible with the 
continuity of f at the point x = 0. 


Example 6 It is slightly more difficult to show that even the set R[a, b] of real- 
valued Riemann-integrable functions defined on the closed interval [a, b] is not 
complete in the sense of the metric (9.14). We shall show this, using the Lebesgue 
criterion for Riemann integrability of a function. 


Proof We take [a, b] to be the closed interval [0, 1], and we shall construct a Cantor 
set on it that is not a set of measure zero. Let A € JO, 1/3[. We remove from the 
interval [0, 1] the middle piece of it of length A. More precisely, we remove the 


5In regard to the metric (9.14) on R[a, b] see the remark to Example 9 in Sect. 9.1. 
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A /2-neighborhood of the midpoint of the closed interval [0, 1]. On each of the two 
remaining intervals, we remove the middle piece of length A - 1/3. On each of the 
four remaining closed intervals we remove the middle piece of length A - 1/37, and 
so forth. The length of the intervals removed in this process is A+ A-2/3+A.- 
4/3*+---+A-(2/3)" +--+. = 3A. Since 0 < A < 1/3 we have 1 —3A > 0, and, as 
one can verify, it follows from this that the (Cantor) set K remaining on the closed 
interval [0, 1] does not have measure zero in the sense of Lebesgue. 

Now consider the following sequence: { f, € 7[0, 1]; € N}. Let f, be a func- 
tion equal to 1 everywhere on [0, 1] except at the points of the intervals removed at 
the first n steps, where it is set equal to zero. It is easy to verify that this sequence is 
a Cauchy sequence in the sense of the metric (9.14). If some function f € R[0, 1] 
were the limit of this sequence, then f would have to be equal to the characteristic 
function of the set K at almost every point of the interval [0, 1]. Then f would have 
discontinuities at all points of the set K. But, since K does not have measure 0, one 
could conclude from the Lebesgue criterion that f ¢ R[0, 1]. Hence R[a, b] with 
the metric (9.14) is not a complete metric space. 


9.5.2 The Completion of a Metric Space 


Example 7 Let us return again to the real line and consider the set Q of rational 
numbers with the metric induced by the standard metric on R. 

It is clear that a sequence of rational numbers converging to V2 in R is a Cauchy 
sequence, but does not have a limit in Q, that is, Q is not a complete space with 
this metric. However, Q happens to be a subspace of the complete metric space R, 
which it is natural to regard as the completion of Q. Note that the set Q Cc R could 
also be regarded as a subset of the complete metric space R7, but it does not seem 
reasonable to call R? the completion of Q. 


Definition 4 The smallest complete metric space containing a given metric space 
(X, d) is the completion of (X, d). 


This intuitively acceptable definition requires at least two clarifications: what is 
meant by the “smallest” space, and does it exist? 

We shall soon be able to answer both of these questions; in the meantime we 
adopt the following more formal definition. 


Definition 5 If a metric space (X, d) is a subspace of a complete metric space (Y, d) 
and the set X C Y is everywhere dense in Y, the space (Y, d) is called a completion 
of the metric space (X, d). 


Definition 6 We say that the metric space (X1, d1) is isometric to the metric space 
(X2, dz) if there exists a bijective mapping f : X; — X2 such that do(f (a), f(b)) = 
d,(a,b) for any points a and b in X . (The mapping f : X; — Xz is called an 
isometry in that case.) 
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It is clear that this relation is reflexive, symmetric, and transitive, that is, it is 
an equivalence relation between metric spaces. In studying the properties of metric 
spaces we study not the individual space, but the properties of all spaces isometric 
to it. For that reason one may regard isometric spaces as identical. 


Example 8 Two congruent figures in the plane are isometric as metric spaces, so 
that in studying the metric properties of figures we abstract completely, for example, 
from the location of a figure in the plane, identifying all congruent figures. 


By adopting the convention of identifying isometric spaces, one can show that if 
the completion of a metric space exists at all, it is unique. 
As a preliminary, we verify the following statement. 


Lemma The following inequality holds for any quadruple of points a, b, u, v of the 
metric space (X, d): 


|d(a, b) — d(u, v)| <d(a,u)+d(b, v). (9.15) 
Proof By the triangle inequality 


d(a, b) <d(a,u) +d(u, v) + d(b, v). 


By the symmetry of the points, this relation implies (9.15). 


We now prove uniqueness of the completion. 


Proposition 1 [f the metric spaces (Y,,d,) and (¥2,d2) are completions of the 
same space (X, da), then they are isometric. 


Proof We construct an isometry f : Yj > Y2 as follows. For x € X we set 
f(x) =x. Then dy(f (x1), f 2) = dC f 01), f (2) = dx, x2) = di (x1, x2) for 
x1,x2 € X. If yy € Yi \X, then yy is a limit point for X, since X is everywhere dense 
in Y;. Let {x,; n € N} be a sequence of points of X converging to y; in the sense of 
the metric d,. This sequence is a Cauchy sequence in the sense of the metric d,. But 
since the metrics d; and d are both equal to d on X, this sequence is also a Cauchy 
sequence in (Y2, dz). The latter space is complete, and hence this sequence has a 
limit y2 € Y2. It can be verified in the standard manner that this limit is unique. We 
now set f(y1) = yo. Since any point y2 € Y2\X, just like any point y; € Y;\X, is the 
limit of a Cauchy sequence of points in X, the mapping f : Yj > Y2 so constructed 
is surjective. 
We now verify that 


do( f(y), £01) = (i971) (9.16) 


for any pair of points y;, y/ of Y1. 
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If y; and y/ belong to X, this equality is obvious. In the general case we take 


two sequences {x/,;n € N} and {x,’;n € N} converging to y; and y/’ respectively. It 


follows from inequality (9.15) that 
di (yy) = Fim di (xp, xn), 
or, what is the same, 
Ay(y,y1) = Tim d(x, m)- (9.17) 


By construction these same sequences converge to y, = f(y}) and y= f(y 
respectively in the space (Y2, d2). Hence 


dy(y), yy) = lim d(x; Xn): (9.18) 


Comparing relations (9.17) and (9.18), we obtain Eq. (9.16). This equality then 
simultaneously establishes that the mapping f : Yj — Y2 is injective and hence 
completes the proof that f is an isometry. 


In Definition 5 of the completion (Y,d) of a metric space (X,d) we required 
that (X,d) be a subspace of (Y,d) that is everywhere dense in (Y,d). Under the 
identification of isometric spaces one could now broaden the idea of a completion 
and adopt the following definition. 


Definition 5’ A complete metric space (Y, dy) is a completion of the metric space 
(X, dx) if there is a dense subspace of (Y, dy) isometric to (X, dx). 
We now prove the existence of a completion. 


Proposition 2 Every metric space has a completion. 


Proof If the initial space itself is complete, then it is its own completion. 

We have already essentially demonstrated the idea for constructing the comple- 
tion of an incomplete metric space (X, dy) when we proved Proposition 1. 

Consider the set of Cauchy sequences in the space (X, dy). Two such sequences 
{x/,;n € N} and {x/'; n € N} are called equivalent or confinal if dy (x},, x’) > 0 as 
n — ov. It is easy to see that confinality really is an equivalence relation. We shall 
denote the set of equivalence classes of Cauchy sequences by S. We introduce a 
metric in S by the following rule. If s’ and s’” are elements of S, and {x}; n € N} and 
{x/’; n € N} are sequences from the classes s’ and s’ respectively, we set 


d(s',s") = lim dx (x;.%). (9.19) 


It follows from inequality (9.15) that this definition is unambiguous: the limit 
written on the right exists (by the Cauchy criterion for a numerical sequence) and is 
independent of the choice of the individual sequences {x/,;n € N} and {x/’;n € N} 
from the classes s’ and s’’. 


9.5 Complete Metric Spaces 27 


The function d(s’, s”) satisfies all the axioms of a metric. The resulting metric 
space (S,d) is the required completion of the space (X, dx). Indeed, (X, dx) is 
isometric to the subspace (Sx, d) of the space (S, d) consisting of the equivalence 
classes of fundamental sequences that contain constant sequences {x, = x € X; 
n € N}. It is natural to identify such a class s € S with the point x ¢ X. The mapping 
f : (X, dx) > (Sx, d) is obviously an isometry. 

It remains to be verified that (Sy, d) is everywhere dense in (S, d) and that (S, d) 
is a complete metric space. 

We first verify that (Sy, d) is dense in (S, d). Let s be an arbitrary element of S 
and {x,;n € N} a Cauchy sequence in (X, dx) belonging to the class s € S. Taking 
En = fn), n € N, we obtain a sequence {&,; 1 € N} of points of (Sx, d) that has 
precisely the element s € S as its limit, as one can see from (9.19). 

We now prove that the space (S, d) is complete. Let {s,; € N} be an arbitrary 
Cauchy sequence in the space (S,d). For each n € N we choose an element &, in 
(Sx, d) such that d(s,, &,) < 1/n. Then the sequence {&,; n € N}, like the sequence 
{sn;n € N}, is a Cauchy sequence. But in that case the sequence {x, = Ff (Gi 
n € N} will also be a Cauchy sequence. The sequence {x,; n € N} defines an ele- 
ment s € S, to which the given sequence {s,; n € N} converges by virtue of relation 
(9.19). 


Remark I Now that Propositions | and 2 have been proved, it becomes understand- 
able that the completion of a metric space in the sense of Definition 5’ is indeed the 
smallest complete space containing (up to isometry) the given metric space. In this 
way we have justified the original Definition 4 and made it precise. 


Remark 2 The construction of the set R of real numbers, starting from the set Q 
of rational numbers could have been carried out exactly as in the construction of 
the completion of a metric space, which was done in full generality above. That is 
exactly how the transition from Q to R was carried out by Cantor. 


Remark 3 In Example 6 we showed that the space 7[a, b] of Riemann-integrable 
functions is not complete in the natural integral metric. Its completion is the impor- 
tant space L[a, b] of Lebesgue-integrable functions. 


9.5.3 Problems and Exercises 


1. a) Prove the following nested ball lemma. Let (X,d) be a metric space and 
B(x, ri) De-+D B(Xp, ‘) D-+- a nested sequence of closed balls in X whose 
radii tend to zero. The space (X, d) is complete if and only if for every such sequence 
there exists a unique point belonging to all the balls of the sequence. 

b) Show that if the condition r, — 0 as n > oo is omitted from the lemma 
stated above, the intersection of a nested sequence of balls may be empty, even in a 
complete space. 
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2. a) Aset E C X of a metric space (X, d) is nowhere dense in X if it is not dense 
in any ball, that is, if for every ball B(x, 7) there is a second ball B(x;,7,) C B(x,r) 
containing no points of the set E. 

A set E is of first category in X if it can be represented as a countable union of 
nowhere dense sets. 

A set that is not of first category is of second category in X. 

Show that a complete metric space is a set of second category (in itself). 

b) Show that if a function f € cm [a, b] is such that Vx € [a, b]}4an Ee NVm >n 
(f™ (x) = 0), then the function f is a polynomial. 


9.6 Continuous Mappings of Topological Spaces 


From the point of view of analysis, the present section and the one following contain 
the most important results in the present chapter. 

The basic concepts and propositions discussed here form a natural, some-times 
verbatim extension to the case of mappings of arbitrary topological or metric spaces, 
of concepts and propositions that are already well known to us in. In the process, 
not only the statement but also the proofs of many facts turn out to be identical 
with those already considered; in such cases the proofs are naturally omitted with a 
reference to the corresponding propositions that were discussed in detail earlier. 


9.6.1 The Limit of a Mapping 


a. The Basic Definition and Special Cases of It 


Definition 1 Let f : X — Y be a mapping of the set X with a fixed base 6 = {B} 
in X into a topological space Y. The point A ¢€ Y is the limit of the mapping f : 
X — Y over the base B, and we write limg f(x) = A, if for every neighborhood 
V(A) of A in Y there exists an element B € B of the base 6 whose image under the 
mapping f is contained in V(A). 


In logical symbols Definition | has the form 


lim f(x) = A:=WV(A) CY BEB (f(B) C V(A)). 


We shall most often encounter the case in which X, like Y, is a topological space 
and B is the base of neighborhoods or deleted neighborhoods of some point a € X. 
Retaining our earlier notation x — a for the base of deleted neighborhoods {U (a)} 
of the point a, we can specialize Definition | for this base: 


lim f(x) = A:=WV(A) CY aU (a) CX (f (U@)) C V(A)). 
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If (X, dx) and (Y, dy) are metric spaces, this last definition can be restated in 
e—6 language: 


Jim) f(x) = A i= Ve > 048 > OWx EX 
(0 <dx(a,x) <6 => dy(A, f (x) < é). 
In other words, 
jim f (x) = A <=> lim dy(A, f@)) =0. 


Thus we see that, having the concept of a neighborhood, one can define the con- 
cept of the limit of a mapping f : X — Y into a topological or metric space Y just 
as was done in the case Y = R or, more generally, Y = R”. 


b. Properties of the Limit of a Mapping 


We now make some remarks on the general properties of the limit. 

We first note that the uniqueness of the limit obtained earlier no longer holds 
when Y is not a Hausdorff space. But if Y is a Hausdorff space, then the limit is 
unique and the proof does not differ at all from the one given in the special cases 
Y=RorY=R’. 

Next, if f : X — Y is a mapping into a metric space, it makes sense to speak of 
the boundedness of the mapping (meaning the boundedness of the set f(X) in Y), 
and of ultimate boundedness of a mapping with respect to the base B in X (meaning 
that there exists an element B of B on which f is bounded). 

It follows from the definition of a limit that if a mapping f : X —> Y ofa set X 
with base G into a metric space Y has a limit over the base B, then it is ultimately 
bounded over that base. 


c. Questions Involving the Existence of the Limit of a Mapping 


Proposition 1 (Limit of a composition of mappings) Let Y be a set with base By 
and g: Y — Z amapping of Y into a topological space Z having a limit over the 
base By. 

Let X be a set with base By and f : X — Y amapping of X into Y such that for 
every element By € By there exists an element Bx € Bx whose image is contained 
in By, that is, f (Bx) C By. 

Under these hypotheses the composition g o f : X — Z of the mappings f and 
g is defined and has a limit over the base Bx, and 


lim = lim : 
Be go f(x) - g(y) 
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For the proof see Theorem 5 of Sect. 3.2. 

Another important proposition on the existence of the limit is the Cauchy crite- 
rion, to which we now turn. This time we will be discussing a mapping f : X > Y 
into a metric space, and in fact a complete metric space. 

In the case of a mapping f : X — Y of the set X into a metric space (Y, d) it is 
natural to adopt the following definition. 


Definition 2 The oscillation of the mapping f : X — Y ona set E Cc X is the 
quantity 


wo(f,E)= sup d(f (x1), f(x). 


X1,X2EE 
The following proposition holds. 


Proposition 2 (Cauchy criterion for existence of the limit of a mapping) Let X be 
a set with a base B, and let f : X — Y be a mapping of X into a complete metric 
space (Y,d). 

A necessary and sufficient condition for the mapping f to have a limit over the 
base B is that for every ¢ > 0 there exists an element B in B on which the oscillation 
of the mapping is less than ¢. 


More briefly: 


Aleem fe) <—Ve>O0IBeB (o(f, B) <£): 


For the proof see Theorem 4 of Sect. 3.2. 

It is useful to remark that the completeness of the space Y is needed only in the 
implication from the right-hand side to the left-hand side. Moreover, if Y is not a 
complete space, it is usually this implication that breaks down. 


9.6.2 Continuous Mappings 


a. Basic Definitions 


Definition 3 A mapping f : X — Y of a topological space (X, Tx) into a topo- 
logical space (Y, ty) is continuous at a point a € X if for every neighborhood 
V(f(a)) CY of the point f(a) € Y there exists a neighborhood U(a) Cc X of the 
point a € X whose image f(U(a)) is contained in V(f(a)). 

Thus, 


f :X — Y is continuous ata € X := 


=VV(f(a)) JU(@ (f(U@) CV(f@)). 
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In the case when X and Y are metric spaces (X, dx) and (Y, dy), Definition 3 
can of course be stated in e—d language: 


f:X — Y is continuous at a € X := 


=Ve > 055 > OVx € X (dx (a,x) <8 => dy(f (a), f(x)) <€). 


Definition 4 The mapping f : X —> Y is continuous if it is continuous at each point 
xEX. 


The set of continuous mappings from X into Y will be denoted C(X, Y). 


Theorem 1 (Criterion for continuity) A mapping f : X — Y of a topological space 
(X, Tx) into a topological space (Y, ty) is continuous if and only if the pre-image 
of every open (resp. closed) subset of y is open (resp. closed) in X. 


Proof Since the pre-image of a complement is the complement of the pre-image, it 
suffices to prove the assertions for open sets. 

We first show that if f € C(X,Y) and Gy € ty, then Gy = f-'(Gy) be- 
longs to ty. If Gy = ©, it is immediate that the pre-image is open. If Gy 4 © 
and a € Gx, then by definition of continuity of the mapping f at the point a, 
for the neighborhood Gy of the point f(a) there exists a neighborhood Ux (a) 
of a € X such that f(Ux(a)) C Gy. Hence Ux(a) C Gy = f'(Gy). Since 
Gy= ees Ux (a), we conclude that Gy is open, that is, Gy € Tx. 

We now prove that if the pre-image of every open set in Y is open in X, then 
f €C(X, Y). But, taking any point a € X and any neighborhood Vy (f (a)) of its 
image f(a) in Y, we discover that the set Uy(a) = f'(Wy(f(a@))) is an open 
neighborhood of a € X, whose image is contained in Vy (f(a)). Consequently we 
have verified the definition of continuity of the mapping f : X — Y at an arbitrary 
pointae X. 


Definition 5 A bijective mapping f : X — Y of one topological space (X, Tx) onto 
another (Y, ty) is a homeomorphism if both the mapping itself and the inverse map- 
ping f~!: ¥Y > X are continuous. 


Definition 6 Topological spaces that admit homeomorphisms onto one another are 
said to be homeomorphic. 


As Theorem | shows, under a homeomorphism f : X — Y of the topological 
space (X, Tx) onto (Y, ty) the systems of open sets Ty and ty correspond to each 
other in the sense that Gy € ty & f(Gx) = Gy € Ty. 

Thus, from the point of view of their topological properties homeomorphic 
spaces are absolutely identical. Consequently, homeomorphism is the same kind 
of equivalence relation in the set of all topological spaces as, for example, isometry 
is in the set of metric spaces. 
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b. Local Properties of Continuous Mappings 


We now exhibit the local properties of continuous mappings. They follow immedi- 
ately from the corresponding properties of the limit. 


Proposition 3 (Continuity of a composition of continuous mappings) Let (X, Tx), 
(Y, ty) and (Z, tz) be topological spaces. If the mapping g : Y — Z is continuous 
at a point b € Y and the mapping f : X — Y is continuous at a point a € X for 
which f (a) = b, then the composition of these mappings g o f : X — Z is continu- 
ous atae X. 


This follows from the definition of continuity of a mapping and Proposition 1. 


Proposition 4 (Boundedness of a mapping in a neighborhood of a point of conti- 
nuity) Ifa mapping f : X — Y of a topological space (X,T) into a metric space 
(Y, d) is continuous at a point a € X, then it is bounded in some neighborhood of 
that point. 


This proposition follows from the ultimate boundedness (over a base) of a map- 
ping that has a limit. 

Before stating the next proposition on properties of continuous mappings, we 
recall that for mappings into R or R” we defined the quantity 


o(f3a):= lim of, Ba, r)) 
r= 
to be the oscillation of f at the point a. Since both the concept of the oscillation 
of a mapping on a set and the concept of a ball B(a,r) make sense in any metric 
space, the definition of the oscillation w(f, a) of the mapping f at the point a also 
makes sense for a mapping f : X — Y of a metric space (X, dx) into a metric space 


(Y, dy). 


Proposition 5 A mapping f : X — Y ofametric space (X, dx) into a metric space 
(Y, dy) is continuous at the point a € X if and only if o(f, a) = 0. 


This proposition follows immediately from the definition of continuity of a map- 
ping at a point. 
c. Global Properties of Continuous Mappings 
We now discuss some of the important global properties of continuous mappings. 


Theorem 2 The image of a compact set under a continuous mapping is compact. 
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Proof Let f : K — Y bea continuous mapping of the compact space (K, Tx) into 
a topological space (Y, ty), and let {G},a € A} be a covering of f(K) by sets 
that are open in Y. By Theorem 1, the sets {GY = f-\(G%), a € A} form an open 
covering of K. Extracting a finite covering G{,..., Ge. we find a finite covering 
G}',..., GY" of f(K) C Y. Thus f(K) is compact in Y. 


Corollary A continuous real-valued function f : K — Rona compact set assumes 
its maximal value at some point of the compact set (and also its minimal value, at 
some point). 


Proof Indeed, f(K) is a compact set in R, that is, it is closed and bounded. This 
means that inf f(K) € f(K) and sup f(K) € f(K). 


In particular, if K is a closed interval [a, b] C R, we again obtain the classical 
theorem of Weierstrass. 

Cantor’s theorem on uniform continuity carries over verbatim to mappings that 
are continuous on compact sets. Before stating it, we must give a necessary defini- 
tion. 


Definition 7 A mapping f : X — Y of a metric space (X, dy) into a metric space 
(Y, dy) is uniformly continuous if for every ¢ > O there exists 6 > O such that the 
oscillation w(f, E) of f on each set E C X of diameter less than 6 is less than e. 


Theorem 3 (Uniform continuity) A continuous mapping f : K — Y of a compact 
metric space K into a metric space (Y, dy) is uniformly continuous. 


In particular, if K is a closed interval in R and Y = R, we again have the classical 
theorem of Cantor, the proof of which given in Sect. 4.2.2 carries over with almost 
no changes to this general case. 

Let us now consider continuous mappings of connected spaces. 


Theorem 4 The image of a connected topological space under a continuous map- 
ping is connected. 


Proof Let f : X — Y be a continuous mapping of a connected topological space 
(X, Tx) onto a topological space (Y, ty). Let Ey be an open-closed subset of Y. By 
Theorem 1, the pre-image Ex = f~!(Ey) of the set Ey is open-closed in X. By the 
connectedness of X, either Ey = @ or Ex = X. But this means that either Ey = @ 
or Ey =Y = f(X). 


Corollary [fa function f : X — R is continuous on a connected topological space 
(X, tT) and assumes values f(a) = A € Rand f(b) = B ER, then for any num- 
ber C between A and B there exists a point c € X at which f(c)=C. 
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Proof Indeed, by Theorem 4 f(X) is a connected set in R. But the only connected 
subsets of R are intervals (see the Proposition in Sect. 9.4). Thus the point C belongs 
to f(X) along with A and B. 


In particular, if X is a closed interval, we again have the classical intermediate- 
value theorem for a continuous real-valued function. 


9.6.3 Problems and Exercises 


1. a) If the mapping f : X — Y is continuous, will the images of open (or closed) 
sets in X be open (or closed) in Y? 

b) If the image, as well as the inverse image, of an open set under the mapping 
jf: X — Y is open, does it necessarily follow that f is a homeomorphism? 

c) If the mapping f : X — Y is continuous and bijective, is it necessarily a 
homeomorphism? 

d) Is a mapping satisfying b) and c) simultaneously a homeomorphism? 


2. Show the following. 


a) Every continuous bijective mapping of a compact space into a Hausdorff 
space is a homeomorphism. 

b) Without the requirement that the range be a Hausdorff space, the preceding 
statement is in general not true. 


3. Determine whether the following subsets of R” are (pairwise) homeomorphic as 
topological spaces: a line, an open interval on the line, a closed interval on the line; 
a sphere; a torus. 

4. A topological space (X, T) is arcwise connected or path connected if any two 
of its points can be joined by a path lying in X. More precisely, this means that for 
any points A and B in X there exists a continuous mapping f : J > X of a closed 
interval [a, b] C R into X such that f(a) = A and f(b) = B. 


a) Show that every path connected space is connected. 

b) Show that every convex set in IR” is path connected. 

c) Verify that every connected open subset of R” is path connected. 

d) Show that a sphere S(a, 7) is path connected in R”, but that it may fail to be 
connected in another metric space, endowed with a completely different topology. 

e) Verify that in a topological space it is impossible to join an interior point of a 
set to an exterior point without intersecting the boundary of the set. 


9.7 The Contraction Mapping Principle 


Here we shall establish a principle that, despite its simplicity, turns out to be an 
effective way of proving many existence theorems. 
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Definition 1 A point a € X is a fixed point of a mapping f : X > X if f(a) =a. 


Definition 2 A mapping f : X — X of a metric space (X, d) into itself is called a 
contraction if there exists a number q, 0 < q < 1, such that the inequality 


d(f (x1), f(x2)) < qd(a1, x2) (9.20) 


holds for any points x; and x2 in X. 


Theorem (Picard°—Banach’ fixed-point principle) A contraction mapping f : X > 
X of a complete metric space (X, d) into itself has a unique fixed point a. 
Moreover, for any point xo € X the recursively defined sequence xo,x| = 
Ff (Xo), ---,Xnt1 = fn), ... converges to a. The rate of convergence is given by 
the estimate 
q’ 


d(a,xXn) < =e (9.21) 


1 
Proof We shall take an arbitrary point x9 € X and show that the sequence x9, x; = 
S (x0), ---,Xn41 = fn), ... is a Cauchy sequence. The mapping f is a contrac- 


tion, so that by Eq. (9.20) 


A(Xn41,Xn) < Gd(Xn, Xn-1) S00 S gq" d(x1, x0) 


and 
d(Xn+k> Xn) < d(Xn, Xn41) 2 Seas d(Xn+k-15 Xn+k) = 
n 
S (qh ght +--+ gh Nd, x0) S Tar, 20). 
From this one can see that the sequence x9, X1,...,%n,-.- 18 indeed a Cauchy 
sequence. 


The space (X,d) is complete, so that this sequence has a limit limy.99 Xx, = 
aeXx. 

It is clear from the definition of a contraction mapping that a contraction is always 
continuous, and therefore 


a= lim x41= lim f@)= t( lim i) = f(a). 
n—oo n—->co N—-> Oo 


Thus a is a fixed point of the mapping f/f. 


®Ch.E. Picard (1856-1941) — French mathematician who obtained many important results in the 
theory of differential equations and analytic function theory. 


7§. Banach (1892-1945) — Polish mathematician, one of the founders of functional analysis. 
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The mapping f cannot have a second fixed point, since the relations a; = f (a;), 
i = 1,2, imply, when we take account of (9.20), that 


0 <d(a\, a) =d(f (ai), f(a)) < qd(ai, a2), 


which is possible only if d(a;, az) = 0, that is, aj = ap. 
Next, by passing to the limit as k — oo in the relation 


n 


d(Xn+ks Xn) < d(x1, Xo), 


1-q 


we find that 


n 


d(a,Xn) < 


d(x1,X0). 


l—q 


The following proposition supplements this theorem. 


Proposition (Stability of the fixed point) Let (X,d) be a complete metric space 
and (82, tT) a topological space that will play the role of a parameter space in what 
follows. 

Suppose to each value of the parameter t € 82 there corresponds a contraction 
mapping f;: X — X of the space X into itself and that the following conditions 
hold. 


a) The family {f;;t € 92} is uniformly contracting, that is, there exists q, 
0 <q <1, such that each mapping f; is a q-contraction. 

b) For each x € X the mapping f(x): 82 — X is continuous as a function of t 
at some point to € Q, that is limy+t) fi(x) = fig (x). 


Then the solution a(t) € X of the equation x = f;(x) depends continuously on t 
at the point to, that is, lim;_,,, a(t) = a(t). 


Proof As was shown in the proof of the theorem, the solution a(t) of the equation 
x = f;(x) can be obtained as the limit of the sequence {x41 = f;(%);n =0,1,...} 
starting from any point x9 € X. Let x9 = a(to) = fig (a(to)). 

Taking account of the estimate (9.21) and condition a), we obtain 


d(a(t),a(to)) = d(a(t), xo) < 


1 i 
< ae = gen) _ Tag tila), fio (a(to))). 


By condition b), the last term in this relation tends to zero as tf > to. Thus it has 
been proved that 


lim d(a(t), a(to)) =0, thatis lim a(t) =a(t). 
t>19 t> 10 
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Example I As an important example of the application of the contraction map- 
ping principle we shall prove, following Picard, an existence theorem for the so- 
lution of the differential equation y’(x) = f(x, y(x)) satisfying an initial condition 
y(xo) = yo. 

If the function f € C(R?,R) is such that 


| f(u, v1) — f (u, v2)| < Mlv1 — v9], 


where M is a constant, then, for any initial condition 


y(x0) = yo, (9.22) 


there exists a neighborhood U (xo) of xo € R and a unique function y = y(x) de- 
fined in U (xo) satisfying the equation 


y= 7069) (9.23) 


and the initial condition (9.22). 


Proof Equation (9.23) and the condition (9.22) can be jointly written as a single 
relation 
x 


y(x) =+f f(t, y@) dt. (9.24) 


xO 
Denoting the right-hand side of this equality by A(y), we find that A : 
C(V (x0), R) > C(V (x0), R) is a mapping of the set of continuous functions de- 
fined on a neighborhood V (xo) of x9 into itself. Regarding C(V (xo), R) as a metric 
space with the uniform metric (see formula (9.6) from Sect. 9.1), we find that 


= 


d(Ay), Ay2) = max i f(t, »1@)) dt — / f (t, y2(0)) dt 


xEV (xg) 0 x0 


< M|x — xold(y1, y2). 


zs 
< max [Mino - ola 
x0 


xEV (xq) 


1 : ‘ 
If we assume that |x — xo| < 377, then the inequality 


1 
d(Ay, Ay2) < 5401, y2) 


is fulfilled on the corresponding closed interval J, where d(y1, y2) = Maxyey|y1(x) — 
y2(x)|. Thus we have a contraction mapping 


A:CU,R)— CU, R) 


of the complete metric space (C(/, R), d) (see Example 4 of Sect. 9.5) into itself, 
which by the contraction mapping principle must have a unique fixed point y = Ay. 
But this means that the function in C(/, R) just found is the unique function defined 
on I > xo and satisfying Eq. (9.24). 
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Example 2 As an illustration of what was just said, we shall seek a solution of the 
familiar equation 


’ 
yy 


with the initial condition (9.22) on the basis of the contraction mapping principle. 
In this case 


x 
Ay = yo +f y(t) dr, 
xo 
and the principle is applicable at least for |x — xo| <q < 1. 
Starting from the initial approximation y(x) = 0, we construct successively the 
sequence 0, yy = A(O),..., Yn4i1(t) = AO (f)), ... of approximations 


yi) = yo, 
yo(t) = yo(1 + (« — xo), 


1 
y3(t) = mo(1 + (x — x0) + a - x9), 
1 2 1 n 
Yat it) = vo(t + (x — x0) + a & —Xo)o Fee + nit — xo) } 


from which it is already clear that 


y(x) = yor *°. 

The fixed-point principle stated in the theorem above also goes by the name of 
the contraction mapping principle. It arose as a generalization of Picard’s proof 
of the existence theorem for a solution of the differential equation (9.23), which 
was discussed in Example 1. The contraction mapping principle was stated in full 
generality by Banach. 


Example 3 (Newton’s method of finding a root of the equation f(x) =0) Suppose a 
real-valued function that is convex and has a positive derivative on a closed interval 
[a, 6] assumes values of opposite signs at the endpoints of the interval. Then there 
is a unique point a in the interval at which f(a) = 0. In addition to the elementary 
method of finding the point a by successive bisection of the interval, there also 
exist more sophisticated and rapid methods of finding it, using the properties of the 
function f. Thus, in the present case, one may use the following method, proposed 
by Newton and called Newton’s method or the method of tangents. Take an arbitrary 
point xo € [a, B] and write the equation y = f (xo) + f’(x0)(x — xo) of the tangent 
to the graph of the function at the point (xo, f(xo)). We then find the point x; = 
xo — Lf’ (xo)]7! - Ff (xo) where the tangent intersects the x-axis (Fig. 9.3). We take 
x, as the first approximation of the root a and repeat this operation, replacing xo 
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Fig. 9.3 


by x1. In this way we obtain a sequence 


Xnt1 =Xn—[F'Gn)] - fn) (9.25) 


of points that, as one can verify, will tend monotonically to a in the present case. 
In particular, if f(x) = x* — a, that is, when we are seeking 4/a, where a > 0, 
the recurrence relation (9.25) has the form 


xk —@ 
Ant+1 =%Xn — — ]y=7> 


Kxy 


which for k = 2 becomes the familiar expression 


1 be a 
X. — Tiel 1,4 = Be 
n+1 2 n Xn 


The method (9.25) for forming the sequence {x,} is called Newton’s method. 
If instead of the sequence (9.25) we consider the sequence obtained by the recur- 
rence relation 


Xn41 =%n—[f' Go] - fGn), (9.26) 


we speak of the modified Newton’s method.® The modification amounts to comput- 
ing the derivative once and for all at the point xo. 
Consider the mapping 


xh A(x) =x—[f' Go] |: £@). (9.27) 


By Lagrange’s theorem 


|AQ@2) — AQ) | =|[f’G0)] | ©) «22 — x11, 


where & is a point lying between x; and x2. 


8Tn functional analysis it has numerous applications and is called the Newton—Kantorovich method. 
L.V. Kantorovich (1912-1986) — eminent Soviet mathematician, whose research in mathematical 
economics earned him the Nobel Prize. 
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Thus, if the conditions 
AU) cI (9.28) 


and 


[Foo] | £@|<¢ <1, (9.29) 


hold on some closed interval J C R, then the mapping A : J > J defined by relation 
(9.27) is a contraction of this closed interval. Then by the general principle it has 
a unique fixed point on the interval. But, as can be seem from (9.27), the condition 
A(a) = a is equivalent to f(a) = 0. 

Hence, when conditions (9.28) and (9.29) hold for a function f, the modi- 
fied Newton’s method (9.26) leads to the required solution x = a of the equation 
f (x) =0 by the contraction mapping principle. 


9.7.1 Problems and Exercises 


1. Show that condition (9.20) in the contraction mapping principle cannot be re- 
placed by the weaker condition 


d(f (x1), f (x2)) < d(x, x2). 


2. a) Prove that if a mapping f : X — X of a complete metric space (X,d) into 
itself is such that some iteration of it f” : X — X is a contraction, then f has a 
unique fixed point. 

b) Verify that the mapping A: CU, R) ~ CU, R) in Example 2 is such that for 
any closed interval J C R some iteration A” of the mapping A is a contraction. 

c) Deduce from b) that the local solution y = yge*—*° found in Example 2 is 
actually a solution of the original equation on the entire real line. 


3. a) Show that in the case of a function on [a@, 6] that is convex and has a positive 
derivative and assumes values of opposite signs at the endpoints, Newton’s method 
really does give a sequence {x,} that converges to the point a € [a, B] at which 
f(a) =09. 


b) Estimate the rate of convergence of the sequence (9.25) to the point a. 


Chapter 10 
*Differential Calculus from a More General 
Point of View 


10.1 Normed Vector Spaces 


Differentiation is the process of finding the best local linear approximation of a func- 
tion. For that reason any reasonably general theory of differentiation must be based 
on elementary ideas connected with linear functions. From the course in algebra the 
reader is well acquainted with the concept of a vector space, as well as linear de- 
pendence and independence of systems of vectors, bases and dimension of a vector 
space, vector subspaces, and so forth. In the present section we shall present vec- 
tor spaces with a norm, or as they are described, normed vector spaces, which are 
widely used in analysis. We begin, however, with some examples of vector spaces. 


10.1.1 Some Examples of Vector Spaces in Analysis 


Example 1 The real vector space R” and the complex vector space C” are classi- 
cal examples of vector spaces of dimension n over the fields of real and complex 
numbers respectively. 


Example 2 In analysis, besides the spaces R” and C” exhibited in Example 1, 
we encounter the space closest to them, which is the space £ of sequences x = 
(x!,...,x”,...) of real or complex numbers. The vector-space operations in £, as 
in R” and C”, are carried out coordinatewise. One peculiarity of this space, when 
compared with R” or C” is that any finite subsystem of the countable system of 
vectors {x; = (0,...,0,x/ =1,0,...),i € N} is linearly independent, that is, @ is an 
infinite-dimensional vector space (of countable dimension in the present case). 

The set of finite sequences (all of whose terms are zero from some point on) is a 
vector subspace é of the space @, also infinite-dimensional. 


Example 3 Let F[a,b] be the set of numerical-valued (real- or complex-valued) 
functions defined on the closed interval [a, b]. This set is a vector space over the 
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corresponding number field with respect to the operations of addition of functions 
and multiplication of a function by a number. 
The set of functions of the form 


(x) 0, ifxe[a,b] andx ¢rt, 
SENSES Veg oie eis Bl and ae 


is a continuously indexed system of linearly independent vectors in F[a, b]. 
The set C[a,b] of continuous functions is obviously a subspace of the space 
F[a, b] just constructed. 


Example 4 If X, and X2 are two vector spaces over the same field, there is a nat- 
ural way of introducing a vector-space structure into their direct product X; x X2, 
namely by carrying out the vector-space operations on elements x = (x1, x2) € 
X 1 xX X2 coordinatewise. 

Similarly one can introduce a vector-space structure into the direct product X1 x 
--- x X, of any finite set of vector spaces. This is completely analogous to the cases 
of R” and C”. 


10.1.2 Norms in Vector Spaces 


We begin with the basic definition. 


Definition 1 Let X be a vector space over the field of real or complex numbers. 
A function || || : X¥ — R assigning to each vector x € X a real number ||x|| is 
called a norm in the vector space X if it satisfies the following three conditions: 


a) ||x|| =0< x = 0 (nondegeneracy); 
b) ||Ax|] = |Al|lx|| (homogeneity); 
c) ||x1 + x2ll < |]x1|| + ||x2|| (the triangle inequality). 


Definition 2 A vector space with a norm defined on it is called a normed vector 
space. 


Definition 3 The value of the norm at a vector is called the norm of that vector. 


The norm of a vector is always nonnegative and, as can be seen by a), equals zero 
only for the zero vector. 


Proof Indeed, by c), taking account of a) and b), we obtain for every x € X, 


0 = l]0|| = |x + (—x)|] < all + ell = lel + All = 2 lla. 
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By induction, condition c) implies the following general inequality. 
lla. +--+ + all S [lal +++ + [all (10.1) 


and taking account of b), one can easily deduce from c) the following useful in- 
equality. 


[ileull = eal] S flea — x2. (10.2) 
Every normed vector space has a natural metric 
d(x1,X2) = |[x1 — x2. (10.3) 


The fact that the function d(x;, x2) just defined satisfies the axioms for a metric 
follows immediately from the properties of the norm. Because of the vector-space 
structure in X the metric d in X has two additional special properties: 


d(x +.x,x2 +x) = |] +x) — @2 +.) = le — x21 = da, x2), 
that is, the metric is translation-invariant, and 
d(Ax1, Axz) = ||Ax1 — Axal] = |/AQ@e1 — x2) |] = [Al llr — x2] = [Ald x1, x2), 
that is, it is homogeneous. 


Definition 4 If a normed vector space is complete as a metric space with the natural 
metric (10.3), it is called a complete normed vector space or Banach space. 


Example 5 If for p => 1 we set 


lxllp = (>H"" (10.4) 


i=1 


for x = (x!,...,x”) € R", it follows from Minkowski’s inequality that we obtain a 
norm on R". The space R” endowed with this norm will be denoted R’.. 
One can verify that 


IXIlp. < lle lp, if1S pi S pr, (10.5) 
and that 
IIx lp > max{|x!|,..., |x|} (10.6) 
as p —> +00. Thus, it is natural to set 
elles amt [oes aocy, (ae? | (10.7) 


It then follows from (10.4) and (10.5) that 


IX lloo S ll*Ilp S Ill Snllxlloo for p> 1. (10.8) 
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It is clear from this inequality, as in fact it is from the very definition of the norm 
\|x || p in Eq. (10.4), that Ri, is a complete normed vector space. 


Example 6 The preceding example can be usefully generalized as follows. If X = 
X1 X--- xX X, is the direct product of normed vector spaces, one can introduce the 
norm of a vector x = (x1,..., Xn») in the direct product by setting 


1 
a P 
Ip = (Sons , pe (10.9) 
i=l 


where ||; || is the norm of the vector x; € X;. 

Naturally, inequalities (10.8) remain valid in this case as well. 

From now on, when the direct product of normed spaces is considered, unless 
the contrary is explicitly stated, it is assumed that the norm is defined in accordance 
with formula (10.9) (including the case p = +00). 


Example 7 Let p = 1. We denote by £, the set of sequences x = Cesag aor 
real or complex numbers such that the series )°>—, |x"|? converges, and for x € £p 
we set 


00 p 
Ixllp i= (>) (10.10) 
n=1 

Using Minkowski’s inequality, one can easily see that ¢, is a normed vector 
space with respect to the standard vector-space operations and the norm (10.10). 
This is an infinite-dimensional space with respect to which R, is a vector subspace 
of finite dimension. 

All the inequalities (10.8) except the last are valid for the norm (10.10). It is not 
difficult to verify that £, is a Banach space. 


Example 8 In the vector space C[a, b] of numerical-valued functions that are con- 
tinuous on the closed interval [a, b], one usually considers the following norm: 


Ifill = max | f(x)]. (10.11) 


x 


We leave the verification of the norm axioms to the reader. We remark that this 
norm generates a metric on C[a, b] that is already familiar to us (see Sect. 9.5), and 
we know that the metric space that thereby arises is complete. Thus the vector space 
C[a, b] with the norm (10.11) is a Banach space. 


Example 9 One can also introduce another norm in C[a, b] 


b 7 
If llp = (/ fl?) ax) e> Pa, (10.12) 


which becomes (10.11) as p > +00. 
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It is easy to see (for example, Sect. 9.5) that the space C[a, b] with the norm 
(10.12) is not complete for 1 < p < +00. 


10.1.3 Inner Products in Vector Spaces 


An important class of normed spaces is formed by the spaces with an inner product. 
They are a direct generalization of Euclidean spaces. 
We recall their definition. 


Definition 5 We say that a Hermitian form is defined in a vector space X (over the 
field of complex numbers) if there exists a mapping (,) : X x X — C having the 
following properties: 


a) (x1, x2) = (x2, x1), 
b) (Ax1, x2) = A(x1, x2), 
C) (x1 + x2, x3) = (%1,.%3) + (X2, X3), 


where x1, x2, x3 are vectors in X anda eC. 


It follows from a), b), and c), for example, that 


(x1, 4X2) = (Ax2, X1) = A(x2, X1) = A(x2, X11) = A(X1, x2); 


—_~| —~ 


(x1, X2 +3) = (x2 +.¥3,.%1) = (x2, 41) + (x3, x1) = (X11, ¥2) + (41, 43); 


(x,x) = (x,x), thatis, (x,x) is areal number. 


A Hermitian form is called nonnegative if 
d) (x,x) 20 

and nondegenerate if 
e) (x,x)=08x=0. 


If X is a vector space over the field of real numbers, one must of course consider 
a real-valued form (x1, x2). In this case a) can be replaced by (x1, x2) = (x2, %1), 
which means that the form is symmetric with respect to its vector arguments x, 
and x2. 

An example of such a form is the dot product familiar from analytic geometry 
for vectors in three-dimensional Euclidean space. In connection with this analogy 
we make the following definition. 


Definition 6 A nondegenerate nonnegative Hermitian form in a vector space is 
called an inner product in the space. 
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Example 10 An inner product of vectors x = (x!,...,x”) and y = (y!,..., y”) 
in R” can be defined by setting 


n 
GaV= oxy (10.13) 
i=l 
and in C” by setting 
i a 
Gai Yoav (10.14) 
i=l 


Example 11 In £2 the inner product of the vectors x and y can be defined as 


Or. y) = Daly! 


i=l 


The series in this expression converges absolutely since 
[o.@) [o,@) [o,@) 
a i /2 j 2 
2d ily s Dokl + Dbl. 
i=l i=1 i=l 


Example 12 An inner product can be defined in C[a, b] by the formula 


b 
(f, 8) =f (f - g)(x) dx. (10.15) 


It follows easily from properties of the integral that all the requirements for an 
inner product are satisfied in this case. 


The following important inequality, known as the Cauchy—Bunyakovskii inequal- 
ity, holds for the inner product: 


2 
(x, y) |" <x) (yy), (10.16) 
where equality holds if and only if the vectors x and y are collinear. 


Proof Indeed, let a = (x, x), b= (x, y), and c = (y, y). By hypothesis a > 0 and 
c > 0. Ifc > 0, the inequalities 


O< (x +tay,x+Ay)=atbra+brat+caa 


with A = - imply 
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bb bb bb 
0<a-—-—+— 
c G 
or 
0 <ac — bb =ac — |b)’, (10.17) 


which is the same as (10.16). 

The case a > 0 can be handled similarly. 

If a=c =O, then, setting A = —b in (10.17), we find 0 < —bb — bb = —2|b|?, 
that is, b = 0, and (10.16) is again true. 

If x and y are not collinear, then 0 < (x ++Ay, x-+Ay) and consequently inequality 
(10.16) is a strict inequality in this case. But if x and y are collinear, it becomes 
equality as one can easily verify. 


A vector space with an inner product has a natural norm: 
Ill] <= v (x, x) (10.18) 
and metric 


d(x, y):=||x — yl]. 


Using the Cauchy—Bunyakovskii inequality, we verify that if (x, y) is a nonde- 
generate nonnegative Hermitian form, then formula (10.18) does indeed define a 
norm. 


Proof 1n fact, 


lvl = V (x, x) =O x =0, 


since the form (x, y) is nondegenerate. 
Next, 


[Axl] = V (Ax, Ax) = Vf AA(x, x) = Aly (x, x) = [Allo 
We verify finally that the triangle inequality holds: 


Ilx + yll S [lel + Ilyl. 


Thus, we need to show that 


Vixty,xty) <V(x,x) + Vly, y), 
or, after we square and cancel, that 
(x,y) + (y, x) S 2 (x, x) + (y, y). 


But 


(x, y) + (y, x) = (x, y) + , y) =2Re(x, y) <2| (x, y) 


’ 
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and the inequality to be proved now follows immediately from the Cauchy— 
Bunyakovskii inequality (10.16). 


In conclusion we note that finite-dimensional vector spaces with an inner product 
are usually called Euclidean or Hermitian (unitary) spaces according as the field of 
scalars is R or C respectively. If a normed vector space is infinite-dimensional, it 
is called a Hilbert space if it is complete in the metric induced by the natural norm 
and a pre-Hilbert space otherwise. 


10.1.4 Problems and Exercises 


1. a) Show that if a translation-invariant homogeneous metric d(x1, x2) is defined 
in a vector space X, then X can be normed by setting ||x|| = d(0, x). 

b) Verify that the norm in a vector space X is a continuous function with respect 
to the topology induced by the natural metric (10.3). 

c) Prove that if X is a finite-dimensional vector space and ||x || and ||.x||’ are two 
norms on X, then one can find positive numbers M, N such that 


M ||x|| < Ilxll!’ < Nill (10.19) 


for any vector x € X. 
d) Using the example of the norms ||x||; and ||x||oo in the space £, verify that 
the preceding inequality generally does not hold in infinite-dimensional spaces. 


2. a) Prove inequality (10.5). 

b) Verify relation (10.6). 

c) Show that as p — +00 the quantity || f||, defined by formula (10.12) tends 
to the quantity || f|| given by formula (10.11). 


3. a) Verify that the normed space £, considered in Example 7 is complete. 
b) Show that the subspace of £,, consisting of finite sequences (ending in zeros) 
is not a Banach space. 


4. a) Verify that relations (10.11) and (10.12) define a norm in the space C[a, b] 
and convince yourself that a complete normed space is obtained in one of these 
cases but not in the other. 

b) Does formula (10.12) define a norm in the space R[a,b] of Riemann- 
integrable functions? 

c) What factorization (identification) must one make in 7[a, b] so that the quan- 
tity defined by (10.12) will be a norm in the resulting vector space? 


5. a) Verify that formulas (10.13)—(10.15) do indeed define an inner product in the 
corresponding vector spaces. 

b) Is the form defined by formula (10.15) an inner product in the space 7[a, b] 
of Riemann-integrable functions? 
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c) Which functions in [a,b] must be identified so that the answer to part b) 
will be positive in the quotient space of equivalence classes? 


6. Using the Cauchy—Bunyakovskii inequality, find the greatest lower bound of the 
values of the product ( J i Ff (x) dx)( iL val 1/f)(x) dx) on the set of continuous real- 
valued functions that do not vanish on the closed interval [a, b]. 


10.2 Linear and Multilinear Transformations 


10.2.1 Definitions and Examples 


We begin by recalling the basic definition. 


Definition 1 If X and Y are vector spaces over the same field (in our case, either R 
or C), a mapping A: X — Y is linear if the equalities 


A(x, +.x2) = A(x1) + A(x), 
A(ax) = 2A(x) 


hold for any vectors x, x;,x2 in X and any number A in the field of scalars. 
For a linear transformation A: X — Y we often write Ax instead of A(x). 


Definition 2 A mapping A: X; x --- x X, — Y of the direct product of the vector 
spaces X1,..., X, into the vector space Y is multilinear (n-linear) if the mapping 
y = A(x1,..., Xn) is linear with respect to each variable for all fixed values of the 
other variables. 


The set of n-linear mappings A: X; x --- x X, — Y will be denoted 
L£(X1,..., Xni Y). 

In particular for n = 1 we obtain the set £(X; Y) of linear mappings from X; = 
X into Y. 

For n = 2 a multilinear mapping is called bilinear, for n = 3, trilinear, and so 
forth. 

One should not confuse an n-linear mapping A € £(X1,..., Xn; Y) with a linear 
mapping A € £(X; Y) of the vector space X = X, x --- x X, (in this connection 
see Examples 9-11 below). 

If Y = R or Y =C, linear and multilinear mappings are usually called linear 
or multilinear functionals. When Y is an arbitrary vector space, a linear mapping 
A: X — Y is usually called a linear transformation from X into Y, and a linear 
operator in the special case when X = Y. 

Let us consider some examples of linear mappings. 
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Example I Let € be the vector space of finite numerical sequences. We define 
a tenioematon A : é > é as follows: 
A((Q1, X2,...,Xn, 0, 2a) t= (1x1, 2x2,...,nXn,0,...). 
Example 2 We define the functional A: C[a, b] > R by the relation 
A(f) = fo), 


where f € C([a, b], R) and xo is a fixed point of the closed interval [a, b]. 


Example 3 We define the functional A : C([a, b], R) > R by the relation 


b 
A(f):= / ¥Gyde: 


Example 4 We define the transformation A : C({a, b],R) > C({a, b], R) by the 
formula 


x 
acf= fo rear, 
a 
where x is a point ranging over the closed interval [a, b]. 


All of these transformations are obviously linear. 
Let us now consider some familiar examples of multilinear mappings. 


Example 5 The usual product (x1,...,%n) > X1-...+X, of n real numbers is a 
typical example of an n-linear functional A € C(R,..., R; R). 
— 


n 


Example 6 The inner product (x1, x2) an (x1, x2) in a Euclidean vector space over 
the field R is a bilinear function. 


Example 7 The cross product (x1, x2) Abe, x2] of vectors in three-dimensional 
Euclidean space E 3 is a bilinear transformation, that is, A € L(E 3 EP: E 3), 


Example 8 If X is a finite-dimensional vector space over the field R, {e1,..., en} is 
a basis in X, and x = x'e; is the coordinate representation of the vector x € X, then, 
setting 


1 n 
x te x xy 
A@t1,..-,tn)edet] > --, : if, 
1 n 
Xn ee Xn 


we obtain an n-linear function A: X” > R. 
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As a useful supplement to the examples just given, we investigate in addition 
the structure of the linear mappings of a product of vector spaces into a product of 


vector spaces. 


Example 9 Let X = X; x --- x Xj, be the vector space that is the direct product of 


the spaces X,,..., Xm, and let A: X — Y bea linear mapping of X into a vector 
space Y. Representing every vector x = (x1,..., Xm) € X in the form 
X= (X1,.--,Xm) = 


= (x1, 0,...,0) + (, x2,0,...,0)+---+(0,...,0, xm) (10.20) 


and setting 


Ai (xj) := A((0,...,0, xi, 0,..., 0)) (10.21) 
for x; € Xi, i = {1,...,m}, we observe that the mappings A; : X; — Y are linear 
and that 

A(x) = Aq(x1) +++ + Am(@m). (10.22) 


Since the mapping A: X = Xj x--- x Xm — Y is obviously linear for any linear 
mappings A; : X; > Y, we have shown that formula (10.22) gives the general form 
of any linear mapping A € C(X = X1 x --- x Xm; Y). 


Example 10 Starting from the definition of the direct product Y= Y; x --- x Y, of 
the vector spaces Yj,..., Y, and the definition of a linear mapping A: X —> Y, one 
can easily see that any linear mapping 


A:X—>~Y=yY,x:::x Vy 
has the form x bh Ax = (A1x,..., Anx) = O1,---, Yn) =y € Y, where Aj : X > 
Y; are linear mappings. 
Example 11 Combining Examples 9 and 10, we conclude that any linear mapping 
A:X,xX-++X¥ Xm=X>Y=Y,x::-xY, 


of the direct product X = X, x--- x X,, of vector spaces into another direct product 
Y=Y, x---x Y, has the form 


ys) (=) 2 ™ «4 > |= Ax, (10.23) 
Yn Ani <:: Anm Xm 


where Aj; : X ; — Y; are linear mappings. 

In particular, if X; = X2 =--- =X, =R and Y; = ¥2=---=Y, =R, then 
Ajj : Xj — Y; are the linear mappings R 5 x +> ajjx € R, each of which is given 
by a single number q;;. Thus in this case relation (10.23) becomes the familiar 
numerical notation for a linear mapping A: R” > R”. 
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10.2.2 The Norm of a Transformation 


Definition 3 Let A: X, x --- x X, — Y be a multilinear transformation mapping 
the direct product of the normed vector spaces X1,..., X, into a normed space Y. 
The quantity 


AQ, .... Xn)ly 
|All = sup * 


Xen M1] xX, X00 X lXnlXq 
Xj 0 


(10.24) 


where the supremum is taken over all sets x1, ..., x, of nonzero vectors in the spaces 
X1,..., Xn, is called the norm of the multilinear transformation A. 


On the right-hand side of Eq. (10.24) we have denoted the norm of a vector x 
by the symbol | - | subscripted by the symbol for the normed vector space to which 
the vector belongs, rather than the usual symbol || - || for the norm of a vector. From 
now on we shall adhere to this notation for the norm of a vector; and, where no 
confusion can arise, we shall omit the symbol for the vector space, taking for granted 
that the norm (absolute value) of a vector is always computed in the space to which 
it belongs. In this way we hope to introduce for the time being some distinction 
in the notation for the norm of a vector and the norm of a linear or multilinear 
transformation acting on a normed vector space. 

Using the properties of the norm of a vector and the properties of a multilinear 
transformation, one can rewrite formula (10.24) as follows: 


Xx] Xn 
||Al| = sup |Aj —,...,—}]= sup |A(e1,---,en)|, (10.25) 
X15+,Xn |x1| |Xn| CLs €n 
Xj 
where the last supremum extends over all sets e),..., @y of unit vectors in the spaces 


X1,-.-, Xn respectively (that is, je)| =1,i=1,...,7). 
In particular, for a linear transformation A : X — Y, from (10.24) and (10.25) 
we obtain 


|Ax| 
|| A|| = sup —— = sup |Ae]. (10.26) 
x40 IX] el=t 
It follows from Definition 3 for the norm of a multilinear transformation A that 
if || Al] < 00, then the inequality 
|A(@x1,...,%n)| < Alllail x +++ x [onl (10.27) 


holds for any vectors x; € X;,i=1,...,n. 
In particular, for a linear transformation we obtain 


|Ax| < ||All|x]. (10.28) 


In addition, it follows from Definition 3 that if the norm of a multilinear trans- 
formation is finite, it is the greatest lower bound of all numbers M for which the 
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inequality 
JAG, «5 an)| SMe] xX La (10.29) 


holds for all values of x; € Xj,i=1,...,n. 


Definition 4 A multilinear transformation A: X; x --- x X, — Y is bounded if 
there exists M € R such that inequality (10.29) holds for all values of x1, ..., x, in 
the spaces X|,..., X» respectively. 


Thus the bounded transformations are precisely those that have a finite norm. 

On the basis of relation (10.26) one can easily understand the geometric meaning 
of the norm of a linear transformation in the familiar case A : R” — R”. In this case 
the unit sphere in R” maps under the transformation A into some ellipsoid in R” 
whose center is at the origin. Hence the norm of A in this case is simply the largest 
of the semiaxes of the ellipsoid. 

On the other hand, one can also interpret the norm of a linear transformation as 
the least upper bound of the coefficients of dilation of vectors under the mapping, 
as can be seen from the first equality in (10.26). 

It is not difficult to prove that for mappings of finite-dimensional spaces the norm 
of a multilinear transformation is always finite, and hence in particular the norm of 
a linear transformation is always finite. This is no longer true in the case of infinite- 
dimensional spaces, as can be seen from the first of the following examples. 

Let us compute the norms of the transformations considered in Examples 1-8. 


Example I' If we regard ¢ as a subspace of the normed space ¢,, in which the 


vector e, = (0,...,0, 1,0...) has unit norm, then, since Ae, = néy, it is clear that 
——J4 


n—1 


|| Al = 00. 


Example 2' If | f| = maxg<x<p |f (x)| < 1, then |Af| = | f(xo)| < 1, and |Af| =1 
if f (xo) = 1, so that ||A]| = 1. 
We remark that if we introduce, for example, the integral norm 


b 
i= f | f(x) dx 


on the same vector space C([a, b], R), the result of computing ||A|| may change 
considerably. Indeed, set [a, b] = [0, 1] and xp = 1. The integral norm of the func- 
tion f, =x” on [0, 1] is obviously ay , while Af, = Ax” = x"|,=1 = 1. It follows 
that || A|| = oo in this case. 

Throughout what follows, unless the contrary is explicitly stated, the space 
C([a, b], R) is assumed to have the norm defined by the maximum of the absolute 
value of the function on the closed interval [a, b]. 
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Example 3’ If | f| = maxg<x<p |f (x)| < 1, then 


b b b 
/ f(x)dx =| iflanar s f er rn 


But for f (x) = 1, we obtain |A1| = b — a, and therefore || A|| = b — a. 


|Af| = 


Example 4’ If | f| = maxa<x<p | f (x)| < 1, then 


[fou 


But for | f|(¢) = 1, we obtain 


max 
a<x<b 


x 
< max, | f\() dt < max (x —a)=b-—a. 
asx<b Jq a<x<b 


P 4 
max / ldt=b—-a, 
a 


a<x<b 


and therefore in this example || A|| = b — a. 
Example 5’ We obtain immediately from Definition 3 that || A|| = 1 in this case. 
Example 6' By the Cauchy—Bunyakovskii inequality 
| (x1, ¥2)| < Leal - Leal, 
and if x; = x2, this inequality becomes equality. Hence || A|| = 1. 
Example 7' We know that 


|[x1, x2]| = |xillx2| sing, 


where ¢ is the angle between the vectors x; and x, and therefore || A|| < 1. At the 
same time, if the vectors x; and x2 are orthogonal, then sing = 1. Thus ||A|| = 1. 


Example 8’ If we assume that the vectors lie in a Euclidean space of dimension n, 

we note that A(x1,...,%) = det(x1,...,Xn) is the volume of the parallelepiped 

spanned by the vectors x;,...,%,, and this volume is maximal if the vectors 

X1,...,X, are made pairwise orthogonal while keeping their lengths constant. 
Thus, 


|ohesth aca se Xd] S [ora] oan lm, 


equality holding for orthogonal vectors. Hence in this case ||A|| = 1. 

Let us now estimate the norms of the operators studied in Examples 9-11. We 
shall assume that in the direct product X = X; x --- x Xm of the normed spaces 
X1,..., Xm the norm of the vector x = (x1,..., Xm) iS introduced in accordance 
with the convention in Sect. 10.1 (Example 6). 
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Example 9 Defining a linear transformation 
A: X, Xs: xX Xy=XY, 


as has been shown, is equivalent to defining the m linear transformations A; : X; > 
Y given by the relations Ajx; = A((0,...,0, x;,0,...,0)),i=1,...,m. When this 
is done, formula (10.22) holds, by virtue of which 


m m m 
sty <tr ols = (Soba) te 
i=l i=l i=l 


Thus we have shown that 


m 
All < 0 Ail. 
i=l 


On the other hand, since 
|Aix;|=|A((O,...,0,2;,0,...,0))| < 
<||All|(O,...,0,27,0,...,0)| =[lAlllzilx;, 
we can conclude that the estimate 
|Aill < IlAll 
also holds for alli = 1,...,m. 


Example 10' Taking account of the norm introduce in Y = Y, x --- x Yj, in this 
case we immediately obtain the two-sided estimates 


n 
Arll < MAIS Do AGM 


i=1 


Example 11' Taking account of the results of Examples 9 and 10, one can conclude 
that 


m n 


Aull <Al< 0 >o WAal- 


i=l] jal 


10.2.3, The Space of Continuous Transformations 


From now on we shall not be interested in all linear or multilinear transformations, 
only continuous ones. In this connection it is useful to keep in mind the following 
proposition. 
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Proposition 1 For a multilinear transformation A: X, x +++ x X,— Y mapping a 
product of normed spaces X,,..., Xp into a normed space Y the following condi- 
tions are equivalent: 


a) A has a finite norm, 

b) A is a bounded transformation, 

c) A is a continuous transformation, 

d) A is continuous at the point (0,...,0) € X1 x --+ x Xn. 


Proof We prove a closed chain of implications a) > b) > c) > d) => a). 

It is obvious from relation (10.27) that a) > b). 

Let us verify that b) > c), that is, that (10.29) implies that the operator A is 
continuous. Indeed, taking account of the multilinearity of A, we can write that 


A(x1 thi, x2 +ha,...,Xn thn) — A(X1, x2,.--,Xn) = 
= A(hy, X2,.--,Xn) +++: FAC, X2,.--,Xn—-1, tn) = 
+ A(hy, 2, X3, 0-2, Xn) Hoe + AM, «+ Xn—25Mn—-1, Mn) + 
+.---+A(hy,..., hn). 


From (10.29) we now obtain the estimate 


|A(r +1, x2 + hy, ...,Xn + hn) — A(t1, x2,--.,%n)| < 


<M(lhq|- [x2]. enl be + oad lead see eal lanl + 
eset [hi]... lAnl), 

from which it follows that A is continuous at each point (x1,...,%,) € X1 X-+- x 
Xp. 

In particular, if (x1, ...,%7) = (0,...,0) we obtain d) from c). 

It remains to be shown that d) => a). 

Given € > 0 we find 6 = 6(€) > 0 such that |A(x1,...,X,)| < ¢ when max{|x_]|, 
..-, |Xn|} <6. Then for any set e),..., @, of unit vectors we obtain 


1 € 
|A(e1,..-,en)| = gal AGer,.--5en)| Sa 


that is, || All < 37 <0. 


We have seen above (Example 1) that not every linear transformation has a finite 
norm, that is, a linear transformation is not always continuous. We have also pointed 
out that continuity can fail for a linear transformation only when the transformation 
is defined on an infinite-dimensional space. 
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From here on £(X1,..., X,; Y) will denote the set of continuous multilinear 
transformations mapping the direct product of the normed vector spaces X1,..., Xn 
into the normed vector space Y. 

In particular, £(X; Y) is the set of continuous linear transformations from X 
into Y. 

In the set £(X1,..., Xn; Y) we introduce a natural vector-space structure: 


(A+ B)(xq,...,X%_) = ACY, ...,%,) + B(x, ..-, Xp) 
and 
(AA) (X1,...,Xn) = AA(X]1,..., Xn). 


It is obvious that if A, B € £L(X1,..., Xn; Y), then (A + B) € L(X],..., Xn Y) 
and (AA) € £(X1,..., Xn; Y). 
Thus £(X,..., Xn; Y) can be regarded as a vector space. 


Proposition 2 The norm of a multilinear transformation is a norm in the vector 
space £L(X1,..., Xn; Y) of continuous multilinear transformations. 


Proof We observe first of all that by Proposition | the nonnegative number || A|| < 
oo is defined for every transformation A € £(X),..., Xn; Y). 
Inequality (10.27) shows that 


|All =OSA=0. 
Next, by definition of the norm of a multilinear transformation 


(AA) (41, ---5 Xn) 7 


AA] = sup 
X1 yeee Xn |xq|-..-+ [Xn 
Xj 
|AIAQ@1, .--.%n)I 
= sup “— = |Al All. 
X] ye Xn |xq|-...+ [Xn 


Finally, if A and B are elements of the space £(X,..., Xn; Y), then 


A+B tac 
At By = sup (APEC al 
Rp jaxesd Xn [xq]-... + [Xnl 
xix 
A(x1,.--,Xn) + BCX, ..., Xn)| 
= sup = 
X15 0005 Xn |xq]-... + [Xnl 
xj; 40 
A(X1,..-,% B(x,...,X%, 
< sup Paoli iia) Ig: sup [Bast ag py, 


Xyendn [Xi] >... + |Xn| Xyendn [Xi] >... + [Xn| 
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From now on when we use the symbol £(X1,..., Xn; Y) we shall have in mind 
the vector space of continuous n-linear transformations normed by this transforma- 
tion norm. In particular £(X, Y) is the normed space of continuous linear transfor- 
mations from X into Y. 

We now prove the following useful supplement to Proposition 2. 


Supplement /f X, Y, and Z are normed spaces and A € L(X;Y) and Be 
L(Y; Z), then 


|| Bo All < | Bll - |All. 


Proof Indeed, 


(Bo A)xl IBIAS! _ 


||B o Al] = sup < 
x40 | x40 (|| 
|Ax| 
= ||B|| sup —— = |B] - |All. 
x40 || 
Proposition 3 Jf Y is a complete normed space, then L(X,,..., Xn; Y) is also a 


complete normed space. 


Proof We shall carry out the proof for the space £(X; Y) of continuous linear trans- 
formations. The general case, as will be clear from the reasoning below, differs only 
in requiring a more cumbersome notation. 

Let Aj, A2,..., An, ... be a Cauchy sequence in £(X; Y). Since for any x € X 
we have 


|Amx — Anx| = |(Am _ An)x| < |[Am — An|||x1, 


it is clear that for any x € X the sequence A,x, Aox,..., Anx,... is a Cauchy se- 
quence in Y. Since Y is complete, it has a limit in Y, which we denote by Ax. 
Thus, 
Ax:= lim Ayx. 


n> oo 


We shall show that A: X — Y is a continuous linear transformation. 
The linearity of A follows from the relations 


lim A,(A,x1 +Aox2) = lim (Ay Ayx1 + A2ApXx2) = 
noo noo 
=), lim Aynxj +A lim Ayxo. 
noo noo 


Next, for any fixed ¢ > 0 and sufficiently large values of m,n € N we have || Am — 
Ay || < €, and therefore 


|Amx — Anx| < e|x| 
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at each vector x € X. Letting m tend to infinity in this last relation and using the 
continuity of the norm of a vector, we obtain 


|Ax — Anx| < e|x|. 
Thus ||A — A,|| < €, and since A = A, + (A — A,,), we conclude that 


|All < l]Anll +. 


Consequently, we have shown that A € £(X; Y) and ||A — A;,|| > 0asn > ov, that 
is, A = limy- oo An in the sense of the norm of the space £(X; Y). 


In conclusion, we make one special remark relating to the space of multilinear 
transformations, which we shall need when studying higher-order differentials. 


Proposition 4 For each m € {1,...,n} there is a bijection between the spaces 
L(X, wees Xmi L£(Xmai, + Xn} Y)) and L(X,...,Xn; Y) 
that preserves the vector-space structure and the norm. 


Proof We shall exhibit this isomorphism. 

Let B € L(X,...,Xm3 L(Xm4i,---,Xni Y)), that is, B(xy,...,x%m) € 
L£(Xm+15 trey Xn; Y). 

We set 


A(x], ..-,Xn) = BI,..., Xm)(Xm+15 ++ +5Xn)- (10.30) 
Then 


[Bx1,..., Xm) Ih 
|B) = sup —— 


XLseees Xm Ix1| ead Xml 


[3B (x4,...,Xm) Xm41 getty Xn)| 
a 


xj #0 IXm+1|+--LXn| 
= sup = 
Misses Xm |xq|-...-[Xm| 
xj40 
A(x1,...,% 
= sup IAGL,- tn) = |All. 
Ki ycsy Xp |x1| aerated [Xn | 


We leave to the reader the verification that relation (10.30) defines an isomor- 
phism of these vector spaces. 


Applying Proposition 4 n times, we find that the space 
£(X1; £(X2;...5 £(Xnj Y)) +++) 


is isomorphic to the space £(X1,..., Xn; Y) of n-linear transformations. 
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10.2.4 Problems and Exercises 


1. a) Prove that if A : X — Y is a linear transformation from the normed space 
X into the normed space Y and X is finite-dimensional, then A is a continuous 
operator. 

b) Prove the proposition analogous to that stated in a) for a multilinear operator. 


2. Two normed vector spaces are isomorphic if there exists an isomorphism be- 
tween them (as vector spaces) that is continuous together with its inverse transfor- 
mation. 


a) Show that normed vector spaces of the same finite dimension are isomorphic. 

b) Show that for the infinite-dimensional case assertion a) is generally no longer 
true. 

c) Introduce two norms in the space C([a, b], R) in such a way that the identity 
mapping of C([a, b], R) is not a continuous mapping of the two resulting normed 
spaces. 


3. Show that if a multilinear transformation of n-dimensional Euclidean space is 
continuous at some point, then it is continuous everywhere. 

4. Let A: E” > E” be a linear transformation of n-dimensional Euclidean space 
and A*: E” + E" the adjoint to this transformation. 

Show the following. 


a) All the eigenvalues of the operator A - A* : E” + E” are nonnegative. 

b) IfA, <--- <A, are the eigenvalues of the operator A - A*, then || Al] = /An. 

c) If the operator A has an inverse A~! : E” > E”, then ||A7!|| = Te 

d) If (a) is the matrix of the operator A: E” — E” in some basis, then the 
estimates — 


n n 


Yi(ai)? <All | So (ai)? < valll 


got Riel 


hold. 


5. Let P[x] be the vector space of polynomials in the variable x with real coeffi- 
cients. We define the norm of the vector P € P[x] by the formula 


1 
|P| ane P2(x) dx. 
0 


a) Is the operator D : P[x] > P[x] given by differentiation (D(P(x)) := P’(x)) 
continuous in the resulting space? 

b) Find the norm of the operator F : P[x] > P[x] of multiplication by x, which 
acts according to the rule F(P(x)) =x - P(x). 
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6. Using the example of projection operators in R, show that the inequality || Bo 
A|l < ||B|| - || All may be a strict inequality. 


10.3 The Differential of a Mapping 


10.3.1 Mappings Differentiable at a Point 


Definition 1 Let X and Y be normed spaces. A mapping f : E > Y ofaset E CX 
into Y is differentiable at an interior point x € E if there exists a continuous linear 
transformation L(x): X — Y such that 


fxth)— f@)=L@)ht+a(x;h), (10.31) 
where a(x; h) =o(h) ash >0,x+he E!! 


Definition 2 The function L(x) € £(X; Y) that is linear with respect to h and satis- 
fies relation (10.31) is called the differential, the tangent mapping, or the derivative 
of the mapping f : E — Y at the point x. 


As before, we shall denote L(x) by df(x), Df (x), or f’(x). 

We thus see that the general definition of differentiability of a mapping at a point 
is a nearly verbatim repetition of the one already familiar to us from Sect. 8.2, where 
it was considered in the case X = R”, Y = R”. For that reason, from now on we 
shall allow ourselves to use such concepts introduced there as increment of a func- 
tion, increment of the argument, and tangent space at a point without repeating the 
explanations, preserving the corresponding notation. 

We shall, however, verify the following proposition in general form. 


Proposition 1 [fa mapping f : E > Y is differentiable at an interior point x of a 
set E C X, its differential L(x) at that point is uniquely determined. 


Proof Thus we are verifying the uniqueness of the differential. 
Let L1(x) and L2(x) be linear mappings satisfying relation (10.31), that is 


f(x +h) — fx) — Lix)h = a(x; h), 
f(x +h) — fx) — Lo(x)h = a(x; h), 


(10.32) 


where a (x;h) =o(h)ash>0,x+he E,i=1,2. 


'The notation “a(x; h) =o(h) ash > 0, x +h € E”, of course, means that 


li sh), -|hly! =0. 
pod, -gl%s dy lle =0 
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Then, setting L(x) = Lo(x) — L1(x) and a(x; h) = a(x; h) — a1 (x; h) and sub- 
tracting the second equality in (10.32) from the first, we obtain 


L(x)h=a(x;h). 


Here L(x) is a mapping that is linear with respect to h, and a(x; h) = o(h) ash > 0, 
x +h € E. Taking an auxiliary numerical parameter 4, we can now write 


|LO)A| = EOE) JOG MM go: ged it 
|A| |Ah| 


Thus L(x)h = 0 for any h 4 0 (we recall that x is an interior point of E). Since 
L(x)0 = 0, we have shown that L)(x)h = L2(x)h for every value of h. 


If E is an open subset of X and f : E > Y is a mapping that is differentiable at 
each point x € E, that is, differentiable on E, by the uniqueness of the differential of 
a mapping at a point, which was just proved, a function E 3 xt> f’(x) € L(X; Y) 
arises on the set E, which we denote f’: E > £L(X;Y). This mapping is called 
the derivative of f, or the derivative mapping relative to the original mapping 
f :.E— Y. The value f’(x) of this function at an individual point x € E is the 
continuous linear transformation f’(x) € £(X; Y) that is the differential or deriva- 
tive of the function f at the particular point x € E. 

We note that by the requirement of continuity of the linear mapping L(x) 
Eq. (10.31) implies that a mapping that is differentiable at a point is necessarily 
continuous at that point. 

The converse is of course not true, as we have seen in the case of numerical 
functions. 

We now make one more important remark. 


Remark If the condition for differentiability of the mapping f at some point a is 
written as 


f(x) — f(@ =L@)(x — a) + aa; x), 


where a(a;x) = o(x — a) as x — a, it becomes clear that Definition | actually 
applies to a mapping f : A — B of any affine spaces (A, X) and (B, Y) whose 
vector spaces X and Y are normed. Such affine spaces, called normed affine spaces, 
are frequently encountered, so that it is useful to keep this remark in mind when 
using the differential calculus. 

Everything that follows, unless specifically stated otherwise, applies equally to 
both normed vector spaces and normed affine spaces, and we use the notation for 
vector spaces only for the sake of simplicity. 
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10.3.2. The General Rules for Differentiation 


The following general properties of the operation of differentiation follow from Def- 
inition |. In the statements below X, Y, and Z are normed spaces and U and V open 
sets in X and Y respectively. 


a. Linearity of Differentiation 


If the mappings f; :U — Y,i = 1,2, are differentiable at a point x € U, a linear 
combination of them (A, f| + A2f2):U — Y is also differentiable at x, and 


(Ar fi + A2f2)' (x) = Ar fi (x) + A2 f(x). 


Thus the differential of a linear combination of mappings is the corresponding 
linear combination of their differentials. 


b. Differentiation of a Composition of Mappings (Chain Rule) 


If the mapping f :U — V is differentiable at a point x € U C X, and the mapping 
g:V —> Z is differentiable at f(x) = y € V CY, then the composition g o f of 
these mappings is differentiable at x, and 


(go f)' (x) =8'(f@)) of’). 


Thus, the differential of a composition is the composition of the differentials. 


c. Differentiation of the Inverse of a Mapping 


Let f :U — Y be a mapping that is continuous at x € U C X and has an inverse 
f7!:V — X that is defined in a neighborhood of y = f (x) and continuous at that 
point. 

If the mapping f is differentiable at x and its tangent mapping f'(x) € L(X;Y) 
has a continuous inverse [f'(x)]~! € L(Y; X), then the mapping f—' is differen- 
tiable at y = f (x) and 


Lf T¢@) =[f'@]". 


Thus, the differential of an inverse mapping is the linear mapping inverse to the 
differential of the original mapping at the corresponding point. 

We omit the proofs of a, b, and c, since they are analogous to the proofs given in 
Sect. 8.3 for the case X = R”, Y= R”. 
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10.3.3, Some Examples 


Example I If f : U > Y is aconstant mapping of a neighborhood U = U(x) c X 
of the point x, that is, f(U) = yo € Y, then f’(x) =O0€ L(X; Y). 


Proof Indeed, in this case it is obvious that 


f@ +h) — f(x) — 0h = yo — yy -0=0= oh). 


Example 2 If the mapping f : X — Y is a continuous linear mapping of a normed 
vector space X into a normed vector space Y, then f’(x) = f € £(X; Y) at any 
point x € A. 


Proof Indeed, 


fth)— fx) — fh= fx+ fh— fx— fh=0. 


We remark that strictly speaking f’(x) € L(T X,; TY f(x)) here and h is a vector 
of the tangent space 7 X,.. But parallel translation of a vector to any point x € X is 
defined in a vector space, and this allows us to identify the tangent space TX, with 
the vector space X itself. (Similarly, in the case of an affine space (A, X) the space 
T Aq of vectors “attached” to the point a € A can be identified with the vector space 
X of the given affine space.) Consequently, after choosing a basis in X, we can 
extend it to all the tangent spaces T X,.. This means that if, for example, X = R’”, 
Y = R", and the mapping f € £(R”; R”) is given by the matrix (a! ), then at every 
point x € R” the tangent mapping f’(x): TR” > TR) will be given by the 
same matrix. 


In particular, for a linear mapping x as ax = y from R to R with x € R and 


h € TR, ~ R, we obtain the corresponding mapping TR, 3h ay ah € TR). 

Taking account of these conventions, we can provisionally state the result of 
Example 2 as follows: The mapping jf’ : X — Y that is the derivative of a linear 
mapping f : X — Y of normed spaces is constant, and f’(x) = f at each point 
xEX. 


Example 3 From the chain rule for differentiating a composition of mappings and 
the result of Example 2 one can conclude that if f : U — Y is a mapping of a 
neighborhood U = U(x) C X of the point x € X and is differentiable at x, while 
AéEL(Y; Z), then 


(Ao f)'(x)=Ao f(x). 


For numerical functions, when Y = Z = R, this is simply the familiar possibility 
of moving a constant factor outside the differentiation sign. 
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Example 4 Suppose once again that U = U(x) is a neighborhood of the point x in 
a normed space X, and let 


f:u-Y=Y,x---x Vp 


be a mapping of U into the direct product of the normed spaces Y,..., Yy. 
Defining such a mapping is equivalent to defining the n mappings f; : U —> Yj, 
i=1,...,”, connected with f by the relation 


xe f(x)=y=(1,--- In) = (A@),---. fx), 


which holds at every point of U. 
If we now take account of the fact that in formula (10.31) we have 


fa th)— f(x) =(fA@+h)— fi)... fale +A) — fal), 
L(x)h = (Li@)h,..., Ln@oh), 
ach) = (oii bh), celal), 


then, referring to the results of Example 6 of Sect. 10.1 and Example 10 of 
Sect. 10.2, we can conclude that the mapping f is differentiable at x if and only 
if all of its components f; : U — Y; are differentiable at x, i = 1,...,; and when 
the mapping f is differentiable, we have the equality 


f°) =(fiG),-.-. £00). 


Example 5 Now let A € £(X1,..., Xn; Y), that is, A is a continuous n-linear trans- 
formation from the product X; x --- x X, of the normed vector spaces X1,..., Xn 
into the normed vector space Y. 

We shall prove that the mapping 


A:X1,xX-:+xX X,=X OY 
is differentiable and find its differential. 


Proof Using the multilinearity of A, we find that 
A(x +h) — A(x) = A(x, +h1,...,Xn thn) — AQ1,.--, Xn) = 
= A(x],...,%n) + ACM, X2,.--,Xn) + 
+++ + A(X, ..-,%n-1, An) + A(A1, h2, x3, ..-5%n) + 
+ +++ + AGI, ..+)Xn—2,Mn—1, hn) + 
+---+A(h,...,4n) -—A(X1,..-,Xn)- 
Since the norm in X = X, x --- x X,, satisfies the inequalities 


n 


Ixilx, < belx < > lily; 
i=l 
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and the norm || A|| of the transformation A is finite and satisfies 


JAG, ---,n)| SAMI x ++ x (End, 
we can conclude that 
A(x +h) — A(x) = A(x, +14,..., Xn, thn) — ACI, ..-, Xn) = 
= A(h1, X2,...,Xn) +++: + A(X... Xn—-1, tn) ta(x; A), 


where a(x; h) =o(h) ash > 0. 
But the transformation 


L(x)h = A(hy, x2,...,Xn) +++ FAQ, wees Xn—1, An) 


is a continuous transformation (because A is continuous) that is linear in h = 


(h1,..., hn). 
Thus we have established that 


A’(x)h = A'(x1,...,%n)C1,.-+, fn) = 
= A(h1, X2,...,Xn) t+» FAC, +5 Xn—1, An), 


or, more briefly, 


dA(x],...,%n) = A(dx], x2,...,%n) +++» HACK, «..., Xn—1, Xn). 


In particular, if: 


a) X1-...+X, is the product of n numerical variables, then 
d(x, +... + Xn) = Ax] X02 - 26. Ky Fee XY. Xn 1 dX} 
b) (x1, x2) is the inner product in E 3 then 
(x1, x2) = (dx1, x2) + (x1, dx); 
c) [x1, x2] is the vector cross product in E 3 then 
d[x1, x2] = [dx1, x2] + [x1, dx]; 
d) (x1, x2, x3) is the scalar triple product in E 3 then 
d(x1, 2, X3) = (dx1, x2, x3) + (x2, dx, x3) + (X12, x2, dx3); 


e) det(x1,...,X,) 1s the determinant of the matrix formed from the coordinates 
of n vectors x1, ..., Xn, in an n-dimensional vector space X with a fixed basis, then 


d(det(x1,...,%n)) = det(dx1, x2, ...,%n) +--+ + det(x1,...,Xn—1, dXn). 
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Example 6 Let U be the subset of £(X; Y) consisting of the continuous linear trans- 
formations A : X — Y having continuous inverse transformations A~! : Y > X 
(belonging to L(Y; X)). Consider the mapping 


(sAisA = Le), 


which assigns to each transformation A € U its inverse AY eLty: X), 
Proposition 2 proved below makes it possible to determine whether this mapping 
is differentiable. 


Proposition 2 /f X is a complete space and A € U, then for any h € L(X; Y) such 
that \|h\| < ||A7!||~!, the transformation A + h also belongs to U and the following 
relation holds: 


(A+h)!=A7!—A'nA! + 0(h) ash—0. (10.33) 


Proof Since 


ead (10.34) 


(A+h)1=(A(E+ATh)) | =(E4 Ah)” 
it suffices to find the operator (EF + Ah inverse to (EF + A~th) € L(X; X), 
where E is the identity mapping ey of X into itself. 

Let A := —A7'h. Taking account of the supplement to Proposition 2 of 
Sect. 10.2, we can observe that || Al] < ||A~!|| - |||], so that by the assumptions 
made with respect to the operator h we may assume that || Al| <q <1. 

We now verify that 


(EA) SA bee a de (10.35) 


where the series on the right-hand side is formed from the linear operators A” = 
(Ao---oA)EL(X; X). 

Since X is a complete normed vector space, it follows from Proposition 3 of 
Sect. 10.2 that the space £(X; X) is also complete. It then follows immediately 
from the relation ||A”|| < || All” <q" and the convergence of the series }°°.9 q” 
for |g| < 1 that the series (10.35) formed from the vectors in that space converges. 

The direct verification that 


(E+ A+A°+---)(E-A)= 
=(E+ AFA? +---)-(A4A?+A?+---)=E 
and 
(E-A)(E+A+A’+---)= 
=(E+ A+ A?+--)-(A4A?4+A34--)=E 


shows that we have indeed found (E — A)~!. 
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It is worth remarking that the freedom in carrying out arithmetic operations on 
series (rearranging the terms!) in this case is guaranteed by the absolute convergence 
(convergence in norm) of the series under consideration. 

Comparing relations (10.34) and (10.35), we conclude that 


(Ath) =A71-—AnA ue a i 


+ (-1)"(A7'h)"AT! +- (10.36) 
for \|Al| < AT! |7'. 
Since 
(oe) (oe) 
Dea tny at} <b UAth|"] 47] s 
n=2 n=2 


< aot qal? yigt= 


m=0 


Fa. 


Eq. (10.33) follows in particular from (10.36). 


Returning now to Example 6, we can say that when the space X is complete the 


mapping A as A~! under consideration is necessarily differentiable, and 
df (A)h=d(A~')h=—A'hA. 


In particular, this means that if A is a nonsingular square matrix and A~! is its 
inverse, then under a perturbation of the matrix A by a matrix h whose elements are 
close to zero, we can write the inverse matrix (A + h)~! in first approximation in 
the following form: 


(Ath)! A7!—ATthAT!, 


More precise formulas can obviously be obtained starting from Eq. (10.36). 
Example 7 Let X be a complete normed vector space. The important mapping 
exp: £L(X; X) > L(X; X) 


is defined as follows: 


1 2 1 n 
GAP pose SAP poe, (10.37) 


= 4 
! Ty 


expA: eae 


if Ae L(X; X). 
The series in (10.37) converges, since £(X; X) is a complete space and 


4 
IF FA" || < ar r , while the numerical series eee ~0 A A converges. 
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It is not difficult to verify that 
exp(A+h)=expA+L(A)h+o(h) ash>ov, (10.38) 


where 


1 1 
L(A)h =h+ 5 (Ah +hA) + = (A*h + AhA + hA*) + 
1 
te to(A™ A+ A" CRA +++» + AA"? +hA"!) +--- 
n! 


and ||L(A)|| < exp ||A|| =e!41, that is, L(A) € L(L(X; X), L(X; X)). 

Thus, the mapping £(X; X) 3 At expA € L(X; X) is differentiable at every 
value of A. 

We remark that if the operators A and h commute, that is, Ah = A, then, as one 
can see from the expression for L(A)hA, in this case we have L(A)h = (exp A)A. In 
particular, for X = R or X = C, instead of (10.38) we again obtain 


exp(A +h) =expA+ (expA)h+o(h) ash—0. (10.39) 


Example 8 We shall attempt to give a mathematical description of the instantaneous 
angular velocity of a rigid body with a fixed point o (a top). Consider an orthonormal 
frame {e;,e2,e3} at the point o rigidly attached to the body. It is clear that the 
position of the body is completely characterized by the position of this orthoframe, 
and the triple {€;, €2,€3} of instantaneous velocities of the vectors of the frame 
obviously give a complete characterization of the instantaneous angular velocity of 
the body. The position of the frame itself {e1, e2,e3} at time ¢ can be given by an 
orthogonal matrix CH ), i, j = 1,2,3 composed of the coordinates of the vectors 
€1, 2, 3 with respect to some fixed orthonormal frame in space. Thus, the motion 
of the top corresponds to a mapping t +> O(t) from R (the time axis) into the group 
SO(3) of special orthogonal 3 x 3 matrices. Consequently, the angular velocity of 
the body, which we have agreed to describe by the triple {@;, €2, €3}, is the matrix 
O(t) =; (w! )(t) — (a@/ )(t), which is the derivative of the matrix O(t) = (a! )(t) 
with respect to time. 
Since O(t) is an orthogonal matrix, the relation 


O(t)O*(th=E (10.40) 


holds at any time t, where O*(t) is the transpose of O(t) and E is the identity 
matrix. 

We remark that the product A - B of matrices is a bilinear function of A and B, 
and the derivative of the transposed matrix is obviously the transpose of the deriva- 
tive of the original matrix. Differentiating (10.40) and taking account of these things, 
we find that 


O(t)O*(t) + O(t)O*(t) =0 
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or 
O(t) =—O(t)O*(t)O(t), (10.41) 


since O*(t)O(t) = E. 
In particular, if we assume that the frame {e;, e2, e3} coincides with the spatial 
frame of reference at time ¢, then O(t) = E, and it follows from (10.41) that 


O(t) =—O*(t), (10.42) 


that is, the matrix O(t) =: Q(t) = (o! ) of coordinates of the vectors {€;, é2, €3} in 
the basis {e;, e2, e3} turns out to be skew-symmetric: 


1 oF 28 
QO, Wy Ww; 0 -—2 
_ 1 2 SW os ) 1 
Qt=|]o, 0 oa)/=] o 0 -—o 
1 2 23 ~w* 1 0 


Thus the instantaneous angular velocity of a top is actually characterized by three 
independent parameters, as follows in our line of reasoning from relation (10.40) 
and is natural from the physical point of view, since the position of the frame 
{e;,€2,e3}, and hence the position of the body itself, can be described by three 
independent parameters (in mechanics these parameters may be, for example, the 
Euler angles). 

If we associate with each vector @ = w'e; + we + we; in the tangent space at 
the point o a right-handed rotation of space with angular velocity |w| about the axis 
defined by this vector, it is not difficult to conclude from these results that at each 
instant of time ¢ the body has an instantaneous angular velocity and that the velocity 
at that time can be adequately described by the instantaneous angular velocity vector 
@(t) (see Problem 5 below). 


10.3.4 The Partial Derivatives of a Mapping 


Let U = U(a) be a neighborhood of the point a € X = Xj x --- x Xj» in the direct 
product of the normed spaces X1,..., Xm, and let f : U — Y be a mapping of U 
into the normed space V. In this case 


y=f(x)= f(@1,.-.,X%m), (10.43) 


and hence, if we fix all the variables but x; in (10.43) by setting x, = ax for k € 
{1,...,m}\i, we obtain a function 


FQ), ..-,Gji-1, Xi, Gi41, «++ m) =! Gi (Xi), (10.44) 


defined in some neighborhood Uj of a; in X. 
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Definition 3 Relative to the original mapping (10.43) the mapping g; : U; > Y is 
called the partial mapping with respect to the variable x; ata € X. 


Definition 4 If the mapping (10.44) is differentiable at x; = a;, its derivative at that 
point is called the partial derivative or partial differential of f at a with respect to 
the variable x;. 


We usually denote this partial derivative by one of the symbols 


jf(@, Di f(a), oF a), pCa 
OX; . 

In accordance with these definitions D; f(a) € £L(Xi; Y). More precisely, 
Dj f(a) € L(T Xi (ai); TY (Ff (@))). 

The differential d f(a) of the mapping (10.43) at the point a (if f is differen- 
tiable at that point) is often called the total differential in this situation in order to 
distinguish it from the partial differentials with respect to the individual variables. 

We have already encountered all these concepts in the case of real-valued func- 
tions of m real variables, so that we shall not give a detailed discussion of them. We 
remark only that by repeating our earlier reasoning, taking account of Example 9 in 
Sect. 9.2, one can prove easily that the following proposition holds in general. 


Proposition 3 [f the mapping (10.43) is differentiable at the point a = (a1, ..., 4m) 
EX, xX--+ X Xm = X, it has partial derivatives with respect to each variable at 
that point, and the total differential and the partial differentials are related by the 
equation 


df (ah = 0) f(a)yhy + +--+ 9nf(ahm, (10.45) 
where h = (hy, ..., hm) € T X\(a1) X --- X TXm(aQn) = TX (a). 


We have already shown by the example of numerical functions that the existence 
of partial derivatives does not in general guarantee the differentiability of the func- 
tion (10.43). 


10.3.5 Problems and Exercises 


1. a) Let A € L(X; X) be a nilpotent operator, that is, there exists k € N such 
that AX = 0. Show that the operator (E — A) has an inverse in this case and that 
(E—A)1=E+A+4.---4+ A], 

b) Let D : P[x] — P[x] be the operator of differentiation on the vector space 
P[x] of polynomials. Remarking that D is a nilpotent operator, write the operator 
exp(aD), where a € R, and show that exp(aD)(P(x)) = P(x +a) =: Tg(P(x)). 
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c) Write the matrices of the operators D: P,[x] > P,[x] and TJ, : P,[x] > 


n-i 


P,[x] from part b) in the basis e; = Gop 1 <i <n, in the space P,,[x] of real 
polynomials of degree n in one variable. 


2. a) If A, Be L(X; X) and 3B! € L(X; X), then exp(B~!AB) = B~! (exp A)B. 
b) If AB = BA, then exp(A + B) = expA- expB. 
c) Verify that expO0 = E and that expA always has an inverse, namely 
(exp A) t= exp(—A). 


3. Let A € £(X; X). Consider the mapping g4 :R — L(X; X) defined by the cor- 
respondence R 5 f + exp(tA) € L(X; X). Show the following. 


a) The mapping ¢, is continuous. 
b) ga isa homomorphism of R as an additive group into the multiplicative group 
of invertible operators in £L(X; X). 


4. Verify the following. 


a) If Aj,...,4, are the eigenvalues of the operator A € £(C”;C”), then 
expdA1,...,eXpA, are the eigenvalues of exp A. 

b) det(exp A) = exp(tr A), where tr A is the trace of the operator A € £(C”, C”). 

c) If A € £(R”, R”), then det(exp A) > 0. 

d) If A* is the transpose of the matrix A ¢ £(C”, C”) and A is the matrix whose 
elements are the complex conjugates of those of A, then (exp A)* = exp A* and 
exp A =expA. 


e) The matrix ‘- Y 


i 0) is not of the form exp A for any 2 x 2 matrix A. 
5. We recall that a set endowed with both a group structure and a topology is called 
a topological group or continuous group if the group operation is continuous. If 
there is a sense in which the group operation is even analytic, the topological group 
is called a Lie group.” 

A Lie algebra is a vector space X with an anticommutative bilinear operation [, ] : 
X x X —> X satisfying the Jacobi identity: [[a, b], c] + [[b, c], a] + [[c, a], b] =0 
for any vectors a, b,c € X. Lie groups and algebras are closely connected with each 
other, and the mapping exp plays an important role in establishing this connection 
(see Problem 1 above). 

Anexample of a Lie algebra is the oriented Euclidean space E> with the operation 
of the vector cross product. For the time being we shall denote this Lie algebra by 
LA. 


a) Show that the real 3 x 3 skew-symmetric matrices form a Lie algebra (which 
we denote LA?) if the product of the matrices A and B is defined as [A, B] = 
AB — BA. 


For the precise definition of a Lie group and the corresponding reference see Problem 8 in 
Sect. 15.2. 
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b) Show that the correspondence 


0 -o @ 
Q=| w 0 —o! | © (@1, a2, 03) =@ 
-w «@! 0 


is an isomorphism of the Lie algebras LA2 and LA}. 

c) Verify that if the skew-symmetric matrix $2 and the vector @ correspond to 
each other as shown in b), then the equality 2r = [w, r] holds for any vector r € E?, 
and the relation PQ P~! <> Pw holds for any matrix P € SO(3). 

d) Verify that if R 5 t+ O(t) € SO(3) is a smooth mapping, then the matrix 
Q(t)=o7! (t)O(t) is skew-symmetric. 

e) Show that if r(¢) is the radius vector of a point of a rotating top and {2(f) is 
the matrix (O~! O)(t) found in d), then r(t) = (S2r)(t). 

f) Let r and @ be two vectors attached at the origin of E*. Suppose a right- 
handed frame has been chosen in E?, and that the space undergoes a right-handed 
rotation with angular velocity |@| about the axis defined by w. Show that r(t) = 
[@, r(t)] in this case. 

g) Summarize the results of d), e), and f) and exhibit the instantaneous angular 
velocity of the rotating top discussed in Example 8. 

h) Using the result of c), verify that the velocity vector w is independent of the 
choice of the fixed orthoframe in E 3. that is, it is independent of the coordinate 
system. 


6. Let r= r(s) = (x!(s), x7(s), x3(s)) be the parametric equations of a smooth 
curve in E?, the parameter being arc length along the curve (the natural parametriza- 
tion of the curve). 


a) Show that the vector o (s)= a T(s) tangent to the curve has unit length. 

b) The vector de 7 (8) = “r(s) is orthogonal to e;. Let e2(s) be the unit vector 
formed from a 248) “The eocticiet k(s) in the equality 7 ile (5) = k(s)ea(s) is called 
the curvature of the curve at the corresponding point. 

c) By constructing the vector e3(s) = [e; (s), e2(s)] we obtain a frame {e1, e2, e3} 
at each point, called the Frenet frame* or companion trihedral of the curve. Verify 
the following Frenet formulas: 


d 
(5) = k(s)er(s), 
d 
ac ) = —k(s)er(s) s2(s)e3(5), 
d 
0) = —se(s)e2(s). 
S 


3).F. Frenet (1816-1900) — French mathematician. 
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Explain the geometric meaning of the coefficient x(s) called the torsion of the 
curve at the corresponding point. 


10.4 The Finite-Increment Theorem and Some Examples 
of Its Use 


10.4.1 The Finite-Increment Theorem 


In our study of numerical functions of one variable in Sect. 5.3.2 we proved the 
finite-increment theorem for them and discussed in detail various aspects of this 
important theorem of analysis. In the present section the finite-increment theorem 
will be proved in its general form. So that its meaning will be fully obvious, we 
advise the reader to recall the discussion in that subsection and also to pay attention 
to the geometric meaning of the norm of a linear operator (see Sect. 10.2.2). 


Theorem 1 (The finite-increment theorem) Let f : U > Y be a continuous map- 
ping of an open set U of anormed space X into a normed space Y. 

If the closed interval [x,x +h] = {& € X |& =x+6h,0 <0 < 1} is contained in 
U and the mapping f is differentiable at all points of the open interval |x, x +h[ = 
{Ee X|E=x+O0h,0 <4 < I}, then the following estimate holds: 


fo+h)-—f@O|ys sup [Ff Ollegylaly- (10.46) 
Ee]x,x+h[ : 


Proof We remark first of all that if we could prove the inequality 


4") se) = sup Lele” —-" (10.47 
€[x’,x” 


in which the supremum extends over the whole interval [x’, x’’], for every closed 
interval [x’, x”] C ]x, x +AL, then, using the continuity of f and the norm together 
with the fact that 


’ 


up [fl] < sup |/’' © 
Ee]x,x+h[ 


S 
€€[x/,x"] 


we would obtain inequality (10.46) in the limit as x’ > x and x” > x +h. 
Thus, it suffices to prove that 


| f(x +h) — f(x)| < MIA, (10.48) 


where M = supgy<g<, || f’(x + 6h)|| and the function f is assumed differentiable on 
the entire closed interval [x, x + h]. 
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The very simple computation 


fG=fG0|S |FG)=fGn| + |7Ga) =F Ops 
< M|x3 — x2| + M|x2 — x1| = M(|x3 — x2| + [x2 — xl) = 


= M\|x3— x1], 


which uses only the triangle inequality and the properties of a closed interval, shows 
that if an inequality of the form (10.48) holds on the portions [x, x2] and [x2, x3] 
of the closed interval [x,, x3], then it also holds on [x1, x3]. 

Hence, if estimate (10.48) fails for the closed interval [x, x + h], then by succes- 
sive bisections, one can obtain a sequence of closed intervals [ax, bg] C ]x,x +h[ 
contracting to some point xo € [x,x + A] such that (10.48) fails on each inter- 
val [az, by]. Since xo € [agz, by], consideration of the closed intervals [ax, xo] and 
[xo, bg] enables us to assume that we have found a sequence of closed intervals of 
the form [xo, x9 + hg] C [x, x +h], where hy — 0 as k > co on which 


| Fx + he) — f(ao)| > M Inkl. (10.49) 


If we prove (10.48) with M replaced by M + e, where ¢ is any positive number, 
we will still obtain (10.48) as ¢ — 0, and hence we can also replace (10.49) by 


|_f (xo + Ae) — f xo)| > (M + £)|he| (10.49’) 


and we can now show that this is incompatible with the assumption that f is differ- 
entiable at xo. 
Indeed, by the assumption that f is differentiable, 


| fo + Ae) — f (%o)| = | f’ Hohe + o(hg)| < 
< | fo) || axl + o(|hel) < (M+ ©) [he | 


as hy > 0. 
The finite-increment theorem has the following useful, purely technical corollary. 
Corollary [f A € £(X; Y), that is, A is a continuous linear mapping of the normed 


space X into the normed space Y and f : U — Y is a mapping satisfying the hy- 
potheses of the finite-increment theorem, then 


|f@+h)— f(x)—Ah| < sup || f')—Allal. 
Ee]x,x+h[ 


Proof For the proof it suffices to apply the finite-increment theorem to the mapping 


tr F(t)= f(x+th) — Ath 


76 10 *Differential Calculus from a More General Point of View 


of the unit interval [0, 1] C R into Y, since 
F(1) — FO) = f@ +h) — f(x) — AA, 
F’(@)= f'(x+0h)h—Ah for0 <0 <1, 
FO] sf @+en)— alla, 
ee | FO! . Pal fe) - Al ee 


Remark As can be seen from the proof of Theorem 1, in its hypotheses there is no 
need to require that f be differentiable as a mapping f : U — Y; it suffices that its 
restriction to the closed interval [x, x + h] be a continuous mapping of that interval 
and differentiable at the points of the open interval |x, x + h[. 


This remark applies equally to the corollary of the finite-increment theorem just 
proved. 


10.4.2: Some Applications of the Finite-Increment Theorem 


a. Continuously Differentiable Mappings 


Let 
f:u-Y (10.50) 


be a mapping of an open subset U of a normed vector space X into a normed 
space Y. If f is differentiable at each point x € U, then, assigning to the point x 
the mapping f’(x) € £(X; Y) tangent to f at that point, we obtain the derivative 
mapping 

f':U > L(X;Y). (10.51) 


Since the space £(X; Y) of continuous linear transformations from X into Y is, 
as we know, a normed space (with the transformation norm), it makes sense to speak 
of the continuity of the mapping (10.51). 


Definition When the derivative mapping (10.51) is continuous in U, the mapping 
(10.50), in complete agreement with our earlier terminology, will be said to be con- 
tinuously differentiable. 


As before, the set of continuously differentiable mappings of type (10.50) will be 
denoted by the symbol Cc (U, Y), or more briefly, CU), if it is clear from the 
context what the range of the mapping is. 

Thus, by definition 


fecMW,Y)s fe c(U, £:Y)). 
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Let us see what continuous differentiability of a mapping means in different par- 
ticular cases. 


Example I Consider the familiar situation when X = Y = R, and hence f:U > R 
is a real-valued function of a real argument. Since any linear mapping A € C(R; R) 
reduces to multiplication by some number a € R, that is, Ah = ah and obviously 
| Al] = la], we find that f’(x)h = a(x)h, where a(x) is the numerical derivative of 
the function f at the point x. 

Next, since 


(f(x +8) — f’@)h= f'@t+dn— f'@h= 
=a(x + 6)h—a(x)h = (a(x +4) —a(x))h, (10.52) 


it follows that 


lf’ +8) — fC) = la +8) —a)| 


and hence in this case continuous differentiability of the mapping f is equivalent to 
the concept of a continuously differentiable numerical function (of class C ©(U,R)) 
studied earlier. 


Example 2 This time suppose that X is the direct product X; x --- x X, of normed 
spaces. In this case the mapping (10.50) is a function f(x) = f(%1,...,m) of m 
variables x; € X;,i=1,...,m, with values in Y. 

If the mapping f is differentiable at x € U, its differential d f(x) at that point is 
an element of the space £L(X, x --- X Xm =X; Y). 

The action of df(x) on a vector h = (hy,..., 4m), by formula (10.45), can be 
represented as 


df(x)h= 0) f(x)hy +:--+0nf hm, 


where 0; f(x): Xi > Y,i=1,...,m, are the partial derivatives of the mapping f 
at the point x under consideration. 
Next, 


m 


(df (x +8)—df(x))h= ¥(3) f(x + 8) — Hf (@)) hi. (10.53) 


i=1 


But by the properties of the standard norm in the direct product of normed spaces 
(see Example 6 in Sect. 10.1.2) and the definition of the norm of a transformation, 
we find that 


aL +3) -—GF Oley ~ S df@+5 —IFOllex.y S 


<> |&SO+8)—AFO|gey.y)- (10.54) 


i=1 
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Thus in this case the differentiable mapping (10.50) is continuously differentiable 
in U if and only if all its partial derivatives are continuous in U. 

In particular, if X¥ = R” and Y = R, we again obtain the familiar concept of 
a continuously differentiable numerical function of m real variables (a function of 
class C) (U, R), where U C R”). 


Remark It is worth noting that in writing (10.52) and (10.53) we have made es- 
sential use of the canonical identification TX, ~ X, which makes it possible to 
compare or identify vectors lying in different tangent spaces. 


We shall now show that continuously differentiable mappings satisfy a Lipschitz 
condition. 


Proposition 1 If K is a convex compact set in a normed space X and f € 
C(K,Y), where Y is also a normed space, then the mapping f : K — Y sat- 
isfies a Lipschitz condition on K, that is, there exists a constant M > 0 such that the 
inequality 


| f 2) — f1)| < Mlx2 - x1 (10.55) 


holds for any points x1,x2€ K. 


Proof By hypothesis f’ : K — £L(X; Y) is a continuous mapping of the compact 
set K into the metric space £(X; Y). Since the norm is a continuous function on a 
normed space with its natural metric, the mapping x +> || f’(x)||, being the compo- 
sition of continuous functions, is itself a continuous mapping of the compact set K 
into R. But such a mapping is necessarily bounded. Let M be a constant such that 
\| f’(x)|| < M at any point x € K. Since K is convex, for any two points x; € K and 
x2 € K the entire interval [x1, x2] is contained in K. Applying the finite-increment 
theorem to that interval, we immediately obtain relation (10.55). 


Proposition 2 Under the hypotheses of Proposition | there exists a non-negative 
function w(6) tending to 0 as 5 > +0 such that 


|f@ +h) — f@)— f’@h| < o()I|h| (10.56) 
at any pointx € K for |h|<difx+hek. 


Proof By the corollary to the finite-increment theorem we can write 
JF +A) — fe) — fh] <_sup | f'@ +h) — f’C||Ihl 
0<0<1 


and, setting 


w(6) = ae || f’G2) — f'n 


X1,X2E 
|x1 —x2| <6 


’ 


10.4 The Finite-Increment (Mean-value) Theorem 79 


we obtain (10.56) in view of the uniform continuity of the function xh f’(x), 
which is continuous on the compact set K. 


b. A Sufficient Condition for Differentiability 


We shall now show that by using the general finite-increment theorem, we can obtain 
a general sufficient condition for differentiability of a mapping in terms of its partial 
derivatives. 


Theorem 2 Let U be a neighborhood of the point x in a normed space X = X, x 
+++ X Xm, which is the direct product of the normed spaces X\ X +--+ X Xm, and let 
f :U—Y bea mapping of U into a normed space Y. If the mapping f has partial 
derivatives with respect to all its variables in U, then it is differentiable at the point 
x if the partial derivatives are all continuous at that point. 


Proof To simplify the writing we carry out the proof for the case m = 2. We verify 
immediately that the mapping 


Lh=0,f (x)hy + 02 f (x)ho, 


which is linear in h = (hj, h2), is the total differential of f at x. 
Making the elementary transformations 


fath)— f(x)-Lh= 
= f(x +hy, x2 +h2) — f (x1, x2) — Of (x)hy — 02 f(x)ho = 
= Fie iy ee ha) =f i a a) = if Ge a 
+ f (x1, 42 + he) — f G1, %2) — dof G1, x2)he2, 


by the corollary to Theorem | we obtain 


| fer +A, x2 + he) — f (1, x2) — 1 f 1, x2)h1 — 92 f (x1, X2)h2| < 


< sup [df (x1 + 1/1, x2 +2) — 1 f (x1, x2) [Al + 
0<6, <1 


+ sup [dof (x1, x2 + 2h2) — dof (x1, x2)|||h2l. (10.57) 
1 


0<62< 


Since max{|h1|, |22} < |h|, it follows obviously from the continuity of the par- 
tial derivatives 0; f and 02 f at the point x = (x1, x2) that the right-hand side of 
inequality (10.57) is o(h) as h = (hy, hz) > 0. 


Corollary A mapping f : U — Y of an open subset U of the normed space X = 
X 1 X-+--X Xm into a normed space Y is continuously differentiable if and only if 
all the partial derivatives of the mapping f are continuous. 
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Proof We have shown in Example 2 that when the mapping f : U — Y is differ- 
entiable, it is continuously differentiable if and only if its partial derivatives are 
continuous. 

We now see that if the partial derivatives are continuous, then the mapping f is 
automatically differentiable, and hence (by Example 2) also continuously differen- 
tiable. 


10.4.3 Problems and Exercises 


1. Let f : 1 — Y beacontinuous mapping of the closed interval J = [0, 1] C R into 
a normed space Y and g: J > Racontinuous real-valued function on J. Show that 
if f and g are differentiable in the open interval ]0, 1[ and the relation || f’(t)|| < 
g’(t) holds at points of this interval, then the inequality | f (1) — f(0)| < g(1) — g(0) 
also holds. 
2. a) Let f : 1 — Y beacontinuously differentiable mapping of the closed interval 
I = [0, 1] C R into a normed space Y. It defines a smooth path in Y. Define the 
length of that path. 

b) Recall the geometric meaning of the norm of the tangent mapping and give 
an upper bound for the length of the path considered in a). 

c) Give a geometric interpretation of the finite-increment theorem. 


3. Let f : U — Y be acontinuous mapping of a neighborhood U of the point a in 
a normed space X into a normed space Y. Show that if f is differentiable in U\a 
and f’(x) has a limit L € £(X; Y) as x — a, then the mapping f is differentiable 
ata and f’(a) = L. 
4. a) Let U be an open convex subset of a normed space X and f:U—> Ya 
mapping of U into a normed space Y. Show that if f’(x) = 0 on U, then the mapping 
f is constant. 

b) Generalize the assertion of a) to the case of an arbitrary domain U (that is, 
when U is an open connected subset of X). 

c) The partial derivative a of a smooth function f : D > R defined in a domain 


D CR? of the xy-plane is identically zero. Is it true that f is then independent of y 
in this domain? For which domains D is this true? 


10.5 Higher-Order Derivatives 
10.5.1 Definition of the nth Differential 
Let U be an open set in a normed space X and 


f:u-Y (10.58) 


a mapping of U into a normed space Y. 
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If the mapping (10.58) is differentiable in U, then the derivative of f, given by 
f':U > L(X; Y), (10.59) 


is defined in U. 

The space £(X; Y) =: Y; is a normed space relative to which the mapping 
(10.59) has the form (10.58), that is, f’ : U — Yj, and it makes sense to speak 
of differentiability for it. 

If the mapping (10.59) is differentiable, its derivative 


(F's U > LK: M1) = £(Xs LOG ¥)) 


is called the second derivative or second differential of f and denoted f” or f®. 
In general, we adopt the following inductive definition. 


Definition 1 The derivative of order n € N or nth differential of the mapping 
(10.58) at the point x € U is the mapping tangent to the derivative of f of order 
n — | at that point. 


If the derivative of order k € N at the point x € U is denoted f(x), Definition 1 
means that 


FO@ = (FY @). (10.60) 
Thus, if f(x) is defined, then 


FP @ELeY) =LOCLO Ya) = 
Sew ( RE Kai o2 (RY) xe.) 


Consequently, by Proposition 4 of Sect. 10.2, f(x), the differential of order n of 
the mapping (10.58) at the point x can be interpreted as an element of the space 
L(X,..., X; Y) of continuous n-linear transformations. 

—<— 

n factors 

We note once again that the tangent mapping f’(x): TX, — TY ,) is a map- 
ping of tangent spaces, each of which, because of the affine or vector-space structure 
of the spaces being mapped, we have identified with the corresponding vector space 
and said on that basis that f’(x) € £(X; Y). It is this device of regarding elements 
f' 1) €L(TXx,3 TY f(x,y) and f’(x2) € LIT Xx, TY f(x), which lie in different 
spaces, as vectors in the same space £(X; Y) that provides the basis for defining 
higher-order differentials of mappings of normed vector spaces. In the case of an 
affine or vector space there is a natural connection between vectors in the differ- 
ent tangent spaces corresponding to different points of the original space. In the 
final analysis, it is this connection that makes it possible to speak of the continuous 
differentiability of both the mapping (10.58) and its higher-order differentials. 
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10.5.2 Derivative with Respect to a Vector and Computation 
of the Values of the nth Differential 


When we are making the abstract Definition | specific, the concept of the derivative 
with respect to a vector may be used to advantage. This concept is introduced for 
the general mapping (10.58) just as was done earlier in the case X = R”, Y=R. 


Definition 2 If X and Y are normed vector spaces over the field R, the derivative 
of the mapping (10.58) with respect to the vector h € TX, ~ X at the point x ¢ U 
is defined as the limit 


h)-— 
Dy fla) = tim F2*" Fe) 


provided this limit exists. 
It can be verified immediately that 
Dyn f (x) =4Dn f(x) (10.61) 


and that if the mapping f is differentiable at the point x € U, it has a derivative at 
that point with respect to every vector; moreover 


Dif (x) = f' A, (10.62) 
and, by the linearity of the tangent mapping, 


Dyyhy+aghy f (%) = A1Dny f(%) + A2Dhy f(x). (10.63) 


It can also be seen from Definition 2 that the value D, f(x) of the derivative of 
the mapping f : U — Y with respect to a vector is an element of the vector space 
TY f(x) ~ Y, and that if L is a continuous linear transformation from Y to a normed 
space Z, then 


Dy(L o f)(x) = Lo Dy f (x). (10.64) 
We shall now try to give an interpretation to the value f (hy, ...,An) of the 
nth differential of the mapping f at the point x on the set (h1,...,4,) of vectors 


hj € TX, ~X,i=1,...,n. 
We begin with n = 1. In this case, by formula (10.62) 


f')(A) = f’@)h = Di f). 


We now consider the case n = 2. Since FO (x) € L(X; L(X; Y)), fixing a vector 
h, € X, we assign a linear transformation (7?) (x)h,) € L(X; Y) to it by the rule 


hyw fO)ny. 
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Then, after computing the value of this operator at the vector h2 € X, we obtain an 
element of Y: 
Ff (we), ho) = (Ff hi )ha € Y. (10.65) 
But 
FO @h= (FY Ch = Daf’), 
and therefore 
f(y, ha) = (Dn f'(@)) hr. (10.66) 


If A € £(X; Y) andh € X, this pairing with Ah can be regarded not only as a 
mapping +> Ah from X into Y, but as a mapping At Ah from £(X; Y) into Y, 
the latter mapping being linear, just like the former. 

Comparing relations (10.62), (10.64), and (10.66), we can write 


(Dn, f!(x))hz = Dn, (f! (&)h2) = Dn, Day f (X). 


Thus we finally obtain 


fF (x) (Ar, h2) = Dn, Day f (x). 


Similarly, one can show that the relation 


FMA, An) = (.-- (FM C)A1).. An) = Dn, Dig +++ Dn, f(x) (10.67) 


holds for any n €N, the differentiation with respect to the vectors being carried 
out sequentially, starting with differentiation with respect to h, and ending with 
differentiation with respect to h1. 


10.5.3 Symmetry of the Higher-Order Differentials 


In connection with formula (10.67), which is perfectly adequate for computation as 
it now stands, the question naturally arises: To what extent does the result of the 
computation depend on the order of differentiation? 


Proposition [f the form f(x) is defined at the point x for the mapping (10.58), it 
is symmetric with respect to any pair of its arguments. 


Proof The main element in the proof is to verify that the proposition holds in the 
case n = 2. 

Let h, and h2 be two arbitrary fixed vectors in the space TX, ~ X. Since U is 
open in X, the following auxiliary function of ¢ is defined for all values of t € R 
sufficiently close to zero: 


Fy (hy, hz) = f(x +t(hy +h2)) — f(x + thy) — f(x +th2) + f(x). 
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We consider also the following auxiliary function: 
g(v) = f(x +t(hy + v)) — f(x +t), 


which is certainly defined for vectors v that are collinear with the vector hz and such 
that |v| < |h2|. 
We observe that 
F, (hi, h2) = g(h2) — g(0). 


We further observe that, since the function f : U — Y has a second differential 
f(x) at the point x € U, it must be differentiable at least in some neighborhood of 
x. We shall assume that the parameter f is sufficiently small that the arguments on 
the right-hand side of the equality that defines F;,(h1, 42) lie in that neighborhood. 

We now make use of these observations and the corollary of the mean-value 
theorem in the following computations: 


| Fi(ay, ho) — 0° f"(x)(a1, h2)| = 
= |g(h2) — g(0) — 27 f"(x)(h1, h2)| < 
< sup |\g’(@2h2) — 27 f"(x)hi|Ihal = 
1 


0<02< 


= up I (f' (x + t(hy + Oph) — f’(@ + 10h) t — 07 f"(e)hy || [hal 
<< 


By definition of the derivative mapping we can write that 
f' (x +t(hy + O2h2)) = f(x) + f(x) (t (a1 + 62h2)) + O(f) 
and 


f(x + t0gh2) = f'(x) + f(x) (tO2h2) + o(t) 


as t —> 0. Taking this relation into account, one can continue the preceding compu- 
tation, finding after cancellation that 


|Fi(i.ha) — 7 f(x), ha)| = o(t*) 
as t —> 0. But this equality means that 


Fi(hy,h 
Fx) (lha, ha) = lim ECE) 
t>0 t 


Since it is obvious that F;(h1, h2) = F, (ho, hj), it follows from this relation that 
fyi, hz) = f"(x)(h2, hi). 

One can now complete the proof of the proposition by induction, repeating ver- 
batim what was said in the proof that the values of the mixed partial derivatives are 
independent of the order of differentiation. 
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Thus we have shown that the nth differential of the mapping (10.58) at the point 
x €U is asymmetric n-linear transformation 


FU WSL i THAT ep) eLO Y) 


whose value on the set (A1,...,h,) of vectors hj € TX, = X,i=1,...,n, can be 
computed by formula (10.67). 

If X is a finite-dimensional space having a basis {e),...,ex} and hj = hie; is 
the expansion of the vector h;, j =1,...,n, with respect to that basis, then by the 


multilinearity of f” (x) we can write 
fF (M1, 0 fn) = FOO) (hileiy, --- hite;,) = 
= fx) (Gi), ..-5 i ais... hi, 
Using our earlier notation 9j,...;,, f(x) for De, --- De, f(x), we find finally that 
FOO) shh) = Ding SAY HEE, 


where as usual summation extends over the repeated indices on the right-hand side 
within their range of variation, that is, from | to k. 
Let us agree to use the following abbreviation: 


fORMA,...,h) =: fM@h". (10.68) 
In particular, if we are discussing a finite-dimensional space X and h = h'e;, then 
fh" = 4j,..5, fA... hin, 


which is already very familiar to us from the theory of numerical functions of several 
variables. 


10.5.4 Some Remarks 


In connection with the notation (10.68) consider the following example, which is 
quite useful and will be used in the next section. 


Example Let A € £L(X1,..., Xn; Y), that is, y = A(x1,...,X) is a continuous n- 
linear transformation from the product of the normed vector spaces X1,..., X,, into 
the normed vector space Y. 

It was shown in Example 5 of Sect. 10.3 that A is a differentiable mapping A : 
X1 X-+++x X,— Y and 


Al (igs Mey Eg ein g Pig) = Ag Ra) vce Re) A Gg Rn Op) 
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Thus, if X; =--- =X, =X and A is symmetric, then 


A'(x,...,x)(h,...,h) =nA(x,...,x,h) =: (nAx"—')h. 
———$ 


n-1 
Hence, if we consider the function F : X — Y defined by the condition 
Xaxpr F(x)=A(x,...,x) =: Ax”, 
it turns out to be differentiable and 
F'(x)h = (nAx"')h, 
that is, in this case 
F'(x) =nAx""!, 
where Ax”—! := A(x,...,x,-). 
- 


In particular, if the mapping (10.58) has a differential f(x) at a point x € U, 
then the function F(h) = f(x)h” is differentiable, and 


F'(h) =nf™ (x)hn""!, (10.69) 


To conclude our discussion of the concept of an nth-order derivative, it is useful 
to add the remark that if the original function (10.58) is defined on a set U ina 
space X that is the direct product of normed spaces Xj,..., Xm, one can speak 
of the first-order partial derivatives 0) f(x), ...,0m f(x) of f with respect to the 
variables x; € X;,i=1,...,m, and the higher-order partial derivatives 0j,...;,, f(x). 

On the basis of Theorem 2 of Sect. 10.4, we obtain by induction in this case that 
if all the partial derivatives 0j,...i, f (x) of a mapping f :U — Y are continuous at 
a point x € X = X; X--- X Xp, then the mapping f has an nth order differential 
f™ (x) at that point. 

If we also take account of the result of Example 2 from the same section, 
we can conclude that the mapping U 3 x f(x) € L(X,..., X; Y) is contin- 

an 
n factors 
uous if and only if all the nth-order partial derivatives U > x +> 0jy...i, f(X) € 
L(Xi,,..., Xi, Y) of the original mapping f : U — Y are continuous (or, what 
is the same, the partial derivatives of all orders up to n inclusive are continuous). 

The class of mappings (10.58) having continuous derivatives up to order n in- 
clusive in U is denoted Cc (U, Y), or, where no confusion can arise, by the briefer 
symbol C(U) or even C™, 

In particular, if X¥ = X; x --- x X;, the conclusion reached above can be written 
in abbreviated form as 


(FEC) Ss Gig f © C teesipS Lae), 


where C, as always, denotes the corresponding set of continuous functions. 
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10.5.5 Problems and Exercises 


1. Carry out the proof of Eq. (10.64) in full. 
2. Give the details at the end of the proof that f(x) is symmetric. 
3. a) Show that if the functions Dz, Dn, f and Dy, Dn, f are defined and contin- 
uous at a point x € U for a pair of vectors hy, hz and the mapping (10.58) in the 
domain U, then the equality Dy, Dn, f (x) = Dn, Dn, f (x) holds. 

b) Show using the example of a numerical ee f(x, y) that, although the 


continuity of the mixed partial derivatives cee say and inte L implies by a) that they are 
equal at this point, it does not in general imply that the second differential of the 
function exists at the point. 


c) Show that, although ee existence of f(x, y), guarantees that the mixed 


partial derivatives ce y and = £ ~ exist and are equal, it does not in general guarantee 
that they are continuous at that point. 


4. Let Ae £L(X,..., X; Y) where A is a symmetric n-linear transformation. Find 
the successive derivatives of the function x Bh Ax” := A(x,...,x) up toordern+ 1 
inclusive. 


10.6 Taylor’s Formula and the Study of Extrema 
10.6.1 Taylor’s Formula for Mappings 


Theorem 1 /f a mapping f :U — Y from a neighborhood U = U(x) of a point 
x in a normed space X into a normed space Y has derivatives up to order n — | 
inclusive in U and has an nth order derivative f(x) at the point x, then 


FQN =I ef Qi ae FOC" + o(|h|") (10.70) 
ash— 0. 


Equality (10.70) is one of the varieties of Taylor’s formula, written here for rather 
general classes of mappings. 


Proof We prove Taylor’s formula by induction. 

For n = 1 it is true by definition of f’(x). 

Assume formula (10.70) is true for some (n — 1) EN. 

Then by the mean-value theorem, formula (10.69) of Sect. 10.5, and the induction 
hypothesis, we obtain 
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= 


yo +h) — (ro + f'@)atet+ afr) 


< sup | f'(@ + 0h) — (re +f" (x)(h) + 
0<é<1 
BF ee SF ancony"-") u = 0(|9h|"~')|h| = o(|h|") 
ash > 0. 


We shall not take the time here to discuss other versions of Taylor’s formula, 
which are sometimes quite useful. They were discussed earlier in detail for numeri- 
cal functions. At this point we leave it to the reader to derive them (see, for example, 
Problem | below). 


10.6.2 Methods of Studying Interior Extrema 


Using Taylor’s formula, we shall exhibit necessary conditions and also sufficient 
conditions for an interior local extremum of real-valued functions defined on an 
open subset of a normed space. As we shall see, these conditions are analogous to 
the differential conditions already known to us for an extremum of a real-valued 
function of a real variable. 


Theorem 2 Let f : U — R be a real-valued function defined on an open set U ina 
normed space X and having continuous derivatives up to order k — | > 1 inclusive 
in a neighborhood of a point x € U and a derivative f(x) of order k at the point 
x itself. 

If f'(x) =0,..., f&-Y (x) = 0 and f(x) 40, then for x to be an extremum 
of the function f it is: 


necessary that k be even and that the form f(x)h* be semidefinite,* and 
sufficient that the values of the form f(x)h* on the unit sphere |h| = 1 be 
bounded away from zero; moreover, x is a local minimum if the inequalities 


f™(yn* >= 5 >0 
hold on that sphere, and a local maximum if 


fan <5 <0. 


‘This means that the form f“(x)h* cannot take on values of opposite signs, although it may 
vanish for some values h # 0. The equality f (x) = 0, as usual, is understood to mean that 
fO (x)h = 0 for every vector h. 
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Proof For the proof we consider the Taylor expansion (10.70) of f in a neighbor- 
hood of x. The assumptions enable us to write 


f(x+h)— f@)= “7? (x)h* + a(n) hk, 


where a(/) is a real-valued function, and a(h) > 0 as h > 0. 

We first prove the necessary conditions. 

Since f(x) 4 0, there exists a vector ho 4 0 on which f) (x)hG # 0. Then 
for values of the real parameter rf sufficiently close to zero, 


lw k k 
FH + tho) — FO) = FF Choy + a (tho) lthol” = 


= (Zr eonns + crho)thol 


and the expression in the outer parentheses has the same sign as f“ (x)hk. 

For x to be an extremum it is necessary for the left-hand side (and hence also the 
right-hand side) of this last equality to be of constant sign when ¢ changes sign. But 
this is possible only if k is even. 

This reasoning shows that if x is an extremum, then the sign of the difference 
f(x + tho) — f(x) is the same as that of f (x)hk for sufficiently small t; hence 
in that case there cannot be two vectors hg, h; at which the form f (k) (x) assumes 
values with opposite signs. 

We now turn to the proof of the sufficiency conditions. For definiteness we con- 
sider the case when f“(x)h* > 5 > 0 for |h| = 1. Then 


fath—f@= FP can + a(h)|A|k = 


= Gaoea +a(t)) ih > (= +a(h)) i 
ki in| =\e 


and, since a(h) — 0 as h — 0, the last term in this inequality is positive for all 
vectors h 4 0 sufficiently close to zero. Thus, for all such vectors h, 


f(axt+h)— f(x) >0, 


that is, x is a strict local minimum. 
The sufficient condition for a strict local maximum is verified similarly. 


Remark 1 If the space X is finite-dimensional, the unit sphere S(x, 1) with center at 
x € X, being a closed bounded subset of X, is compact. Then the continuous func- 
tion f (x) = 0;,..i, fA"! -...-h’* (a k-form) has both a maximal and a min- 
imal value on S(x, 1). If these values are of opposite sign, then f does not have an 
extremum at x. If they are both of the same sign, then, as was shown in Theorem 2, 
there is an extremum. In the latter case, a sufficient condition for an extremum can 
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obviously be stated as the equivalent requirement that the form f“ (x)h* be either 
positive- or negative-definite. 

It was this form of the condition that we encountered in studying real-valued 
functions on R”. 


Remark 2 As we have seen in the example of functions f : R” — R, the semi- 
definiteness of the form f“A* exhibited in the necessary conditions for an ex- 
tremum is not a sufficient criterion for an extremum. 


Remark 3 In practice, when studying extrema of differentiable functions one nor- 
mally uses only the first or second differentials. If the uniqueness and type of ex- 
tremum are obvious from the meaning of the problem being studied, one can restrict 
attention to the first differential when seeking an extremum, simply finding the point 
x where f(x) =0. 


10.6.3 Some Examples 


Example] Let L ¢ C“ (R3,R) and f € C({a,b],R). In other words, 
(u!, u2,u?) > L(u!, u2,u3) is a continuously differentiable real-valued function 
defined in R? and x b f(x) a smooth real-valued function defined on the closed 
interval [a,b] CR. 

Consider the function 


F:C({a,b],R) >R (10.71) 


defined by the relation 


b 


C\) ([a,b],R) 3 fe r= | L(x, f(x), f’(x)) dx ER. (10.72) 


Thus, (10.71) is a real-valued functional defined on the set of functions f € 
C(1)([a, b], R). 

The basic variational principles connected with motion are known in physics 
and mechanics. According to these principles, the actual motions are distinguished 
among all the conceivable motions in that they proceed along trajectories along 
which certain functionals have an extremum. Questions connected with the extrema 
of functionals are central in optimal control theory. Thus, finding and studying the 
extrema of functionals is a problem of intrinsic importance, and the theory associ- 
ated with it is the subject of a large area of analysis — the calculus of variations. 
We have already done a few things to make the transition from the analysis of the 
extrema of numerical functions to the problem of finding and studying extrema of 
functionals seem natural to the reader. However, we shall not go deeply into the 
special problems of variational calculus, but rather use the example of the func- 
tional (10.72) to illustrate only the general ideas of differentiation and study of local 
extrema considered above. 
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We shall show that the functional (10.72) is a differentiable mapping and find its 
differential. 

We remark that the function (10.72) can be regarded as the composition of the 
mappings 


F,:C ([a, b], R) > C([a, 6], R) (10.73) 
defined by the formula 
F\(f)(x) = L(x, Ff), f’@)) (10.74) 
followed by the mapping 
b 
C([a, 6], R) IEgr rye) = | g(x)dx ER. (10.75) 


By properties of the integral, the mapping F> is obviously linear and continuous, 
so that its differentiability is clear. 
We shall show that the mapping F} is also differentiable, and that 


Fi(f h(x) = L(x, FOr), fC) AC) + O3L (x, £O), f’))A(xe) (10.76) 


for h e C (fa, b], R). 
Indeed, by the corollary to the mean-value theorem, we can write in the present 
case 


3 
L(u' + Alu? + A*,u? + A*) — L(u', uweu )— 2a (u' ue se AS 
< sup ||\(a:L@+ 6A) — Lu), L(ut+ OA) — LW), 
0<é<1 


d3L(u + 0A) — a3L(u)) || -|Al < 


<3 max |d;L(u + Ou) — d;L(u)|- max 
0<é<1 i=1,2,3 
i=1,2,3 


(10.77) 


where u = (u!, u*, u>) and A= (A!, A?, A). 

If we now recall that the norm | f|ca) of the function f in C ({a, b], R) is 
max{|f lc, | f’lc} (where | f|c is the maximum absolute value of the function on the 
closed interval [a, b]), then, setting u! = x, u? = f(x), uw = f(x), A! =0, A? = 
h(x), and A? = h’(x), we obtain from inequality (10.77), taking account of the 
uniform continuity of the functions a,L(u}, u, u?), i = 1, 2,3, on bounded subsets 
of R°?, that 


max |L(x, f(x) +h), f(@) +A) — L(x, f@), f@)) - 
— L(x, f(x), f@))h(e) — L(X, F@) F/O) = 


=o(JAlea) as |h|ea > 0. 
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But this means that Eq. (10.76) holds. 
By the chain rule for differentiating a composite function, we now conclude that 
the functional (10.72) is indeed differentiable, and 


b 
F'(f)h -| ((d2L(x, FO) f’@)) h(x) + O3L (x, f(a), f/)))A' (x) dex. 

7 (10.78) 
We often consider the restriction of the functional (10.72) to the affine space 
consisting of the functions f € C () ([a, b], R) that assume fixed values f@=A, 
f(b) = B at the endpoints of the closed interval [a, b]. In this case, the functions h 
in the tangent space TC ) must have the value zero at the endpoints of the closed 
interval [a,b]. Taking this fact into account, we may integrate by parts in (10.78) 

and bring it into the form 


b d 
F(f\h= / (sot (x. £09. £00) — Lane (s, F099) Joo de, (10.79) 


of course under the assumption that L and f belong to the corresponding class C®). 

In particular, if f is an extremum (extremal) of such a functional, then by 
Theorem 2 we have F’(f)h = 0 for every function h € Cc (fa, b], R) such that 
h(a) = h(b) = 0. From this and relation (10.79) one can easily conclude (see Prob- 
lem 3 below) that the function f must satisfy the equation 


d 
L(x, f(x), f’(x)) — ql (x £0), £09) =0. (10.80) 


This is a frequently-encountered form of the equation known in the calculus of 
variations as the Euler-Lagrange equation. 
Let us now consider some specific examples. 


Example 2 (The shortest-path problem) Among all the curves in a plane joining two 
fixed points, find the curve that has minimal length. 

The answer in this case is obvious, and it rather serves as a check on the formal 
computations we will be doing later. 

We shall assume that a fixed Cartesian coordinate system has been chosen in 
the plane, in which the two points are, for example, (0,0) and (1,0). We confine 
ourselves to just the curves that are the graphs of functions f ¢ C)({0, 1], R) as- 
suming the value zero at both ends of the closed interval [0, 1]. The length of such 


a curve 
1 
F(f) -| V1+(f’)"@) dx (10.81) 


depends on the function f and is a functional of the type considered in Example 1. 
In this case the function L has the form 
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and therefore the necessary condition (10.80) for an extremal here reduces to the 
equation 


d ( f'@) )- ‘5 
dx \ /1+ (F(a) 
from which it follows that 
f'() 
V1+(f'?() 


= const (10.82) 


on the closed interval [0, 1]. 
Since the function —4 


is not constant on any interval, Eq. (10.82) is possible 


z] 
7) 


only if f’(x) = const on [a, b]. Thus a smooth extremal of this problem must be a 
linear function whose graph passes through the points (0, 0) and (1, 0). It follows 
that f(x) = 0, and we arrive at the closed interval of the line joining the two given 
points. 


Example 3 (The brachistochrone problem) The classical brachistochrone problem, 
posed by Johann Bernoulli I in 1696, was to find the shape of a track along which 
a point mass would pass from a prescribed point Po to another fixed point P; at a 
lower level under the action of gravity in the shortest time. 

We neglect friction, of course. In addition, we shall assume that the trivial case 
in which both points lie on the same vertical line is excluded. 

In the vertical plane passing through the points Po and P; we introduce a rect- 
angular coordinate system such that Po is at the origin, the x-axis is directed ver- 
tically downward, and the point P; has positive coordinates (x1, y,). We shall find 
the shape of the track among the graphs of smooth functions defined on the closed 
interval [0, x;] and satisfying the condition f(0) = 0, f(x,) = y;. At the moment 
we shall not take time to discuss this by no means uncontroversial assumption (see 
Problem 4 below). 

If the particle began its descent from the point Pp with zero velocity, the law of 
variation of its velocity in these coordinates can be written as 


v= /2ex. (10.83) 


Recalling that the differential of the arc length is computed by the formula 


te vax? + (dy)? = i +(f)'@adx, (10.84) 


we find the time of descent 


1p AL ECE2@) 
FN=se | : dx (10.85) 


along the trajectory defined by the graph of the function y = f(x) on the closed 
interval [0, x1]. 
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For the functional (10.85) 


1+ (u3)2 
1 . 


and therefore the condition (10.80) for an extremum reduces in this case to the 
equation 


d f(x) ) 
= 0, 
dx (Ta PY Co) 
from which it follows that 
f(x) 
soo ee 
V1+(f)7 (x) 


where c is a nonzero constant, since the points are not both on the same vertical line. 
Taking account of (10.84), we can rewrite (10.86) in the form 


(10.86) 


d 
= ee. (10.87) 
ds 


However, from the geometric point of view 


dx dy, 
— =cosg, —=sing, (10.88) 
ds ds 


where ¢ is the angle between the tangent to the trajectory and the positive x-axis. 


By comparing Eq. (10.87) with the second equation in (10.88), we find 


1 
x= —sin’g. (10.89) 


C2 


But it follows from (10.88) and (10.89) that 


dy dy dx sin’ g sin’ y 
— =: =tang— = tang =2 ; 
dg dx dg d di C2 oO 
from which we find 
2 
y= 5g — sin2g) + b. (10.90) 
C 


Setting 2/c* =: a and 29 =: t, we write relations (10.89) and (10.90) as 


x =a(1—cosf), 
(10.91) 
y=a(t—sint) +b. 


Since a 4 0, it follows that x = 0 only for t = 2kz, k € Z. It follows from the 
form of the function (10.91) that we may assume without loss of generality that the 
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parameter value t = 0 corresponds to the point Po = (0, 0). In this case Eq. (10.90) 
implies b = 0, and we arrive at the simpler form 


x =a(1—cosf), 
(10.92) 
y=a(t — sint) 


for the parametric definition of this curve. 

Thus the brachistochrone is a cycloid having a cusp at the initial point Pp where 
the tangent is vertical. The constant a, which is a scaling coefficient, must be chosen 
so that the curve (10.92) also passes through the point P;. Such a choice, as one can 
see by sketching the curve (10.92), is by no means always unique, and this shows 
that the necessary condition (10.80) for an extremum is in general not sufficient. 
However, from physical considerations it is clear which of the possible values of 
the parameter a should be preferred (and this, of course, can be confirmed by direct 
computation). 


10.6.4 Problems and Exercises 


1. Let f : U — Y bea mapping of class C (U; Y) from an open set U inanormed 
space X into a normed space Y. Suppose the closed interval [x, x + h] is entirely 
contained in U, that f has a differential of order (n + 1) at the points of the open 
interval ]x,x + A[, and that || f+) (é)|] < M at every point € € Jx, x +A[. 


a) Show that the function 


1 
g(t) = f(x + th) — (ro ef GOGH) b= 4h af ™eceny") 


is defined on the closed interval [0, 1] C R and differentiable on the open interval 
]0, 1[, and that the estimate 


1 
|s’@|] < —Mienl|n 
Nn. 


holds for every ¢ € ]0, I[. 
b) Show that |g(1) — g(0)| < aap MlAlntt. 
c) Prove the following version of Taylor’s formula: 


< ken 


~ (n+1)! 


ro +h) — (F009 + f'n = Fon) 


d) What can be said about the mapping f : U — Y if it is known that 
f°D (x) =0in U? 


2. a) If a symmetric n-linear operator A is such that Ax” = 0 for every vector 
x € X, then A(x,...,Xn) = 0, that is, A equals zero on every set x1,...,X, of 
vectors in X. 
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b) Ifamapping f : U > Y has annth-order differential f(x) at a point x € U 
and satisfies the condition 


1 
f(e+h)=Lot+Liht+---+ open + a(h)|h|", 


where L;, i = 0,1,...,, are i-linear operators, and a(h) > 0 as h — 0, then 
Lj = f(«),i=0,1,...,n. 

c) Show that the existence of the expansion for f given in the preceding problem 
does not in general imply the existence of the nth order differential f(x) (for 
n > 1) for the function at the point x. 

d) Prove that the mapping £(X;Y) 3 Ate Aq! € L(X;Y) is infinitely dif- 
ferentiable in its domain of definition, and that (A~!)™(A)(h,...,hn) = 
(1A yA ha ss AHA. 


3. a) Let g € C([a, b], R). Show that if the condition 
b 
/ g(x)h(x) dx =0 
a 


holds for every function h € C®([a,b],R) such that h(a) = h(b) = 0, then 
v(x) =0 on [a, bd]. 

b) Derive the Euler-Lagrange equation (10.80) as a necessary condition for 
an extremum of the functional (10.72) restricted to the set of functions f € 
C®({a, b], R) assuming prescribed values at the endpoints of the closed interval 
[a, D]. 


4. Find the shape y = f(x), a < x <b, of a meridian of the surface of revolution 
(about the x-axis) having minimal area among all surfaces of revolution having 
circles of prescribed radius rg and rp as their sections by the planes x = a and x = b 
respectively. 

5. a) The function L in the brachistochrone problem does not satisfy the condi- 
tions of Example 1, so that we cannot justify a direct application of the results of 
Example | in this case. Show by repeating the derivation of formula (10.79) with 
necessary modifications that this equation and Eq. (10.80) remain valid in this case. 

b) Does the equation of the brachistochrone change if the particle starts from the 
point Po with a nonzero initial velocity (the motion is frictionless in a closed pipe)? 

c) Show that if P is an arbitrary point of the brachistochrone corresponding 
to the pair of points Po, P;, the arc of that brachistochrone from Pp to P is the 
brachistochrone of the pair Po, P. 

d) The assumption that the brachistochrone corresponding to a pair of points 
Po, P, can be written as y = f(x), is not always justified, as was revealed by the 
final formulas (10.92). Show by using the result of c) that the derivation of (10.92) 
can be carried out without any such assumption as to the global structure of the 
brachistochrone. 

e) Locate a point P; such that the brachistochrone corresponding to the pair of 
points Po, P; in the coordinate system introduced in Example 3 cannot be written 
in the form y = f(x). 


10.7. The General Implicit Function Theorem 97 


f) Locate a point P; such that the brachistochrone corresponding to the pair 
of points Po, P; in the coordinate system introduced in Example 3 has the form 
y= f(x), and f ¢ C) ({a, b], R). Thus it turns out that in this case the functional 
(10.85) we are interested in has a greatest lower bound on the set Cc ({a, b], R), 
but not a minimum. 

g) Show that the brachistochrone of a pair of points Po, P; of space is a smooth 
curve. 


6. Let us measure the distance d(Po, P) of the point Po of space from the point P; 
in a homogeneous gravitational field by the time required for a point mass to move 
from one point to the other along the brachistochrone corresponding to the points. 


a) Find the distance from the point Po to a fixed vertical line, measured in this 
sense. 

b) Find the asymptotic behavior of the function d(Po, P;) as the point P; is 
raised along a vertical line, approaching the height of the point Pp. 

c) Determine whether the function d( Pp, P;) is a metric. 


10.7 The General Implicit Function Theorem 


In this concluding section of the chapter we shall illustrate practically all of the 
machinery we have developed by studying an implicitly defined function. The reader 
already has some idea of the content of the implicit theorem, its place in analysis, 
and its applications from Chap. 8. For that reason, we shall not go into detail here 
with preliminary explanations of the essence of the matter preceding the formalism. 
We note only that this time the implicitly defined function will be constructed by an 
entirely different method, one that relies on the contraction mapping principle. This 
method is often used in analysis and is quite useful because of its computational 
efficiency. 


Theorem Let X, Y, and Z be normed spaces (for example, R™, R", and R*), Y be- 

ing a complete space. Let W = {(x, y) € X x Y | |x —xo| <a A|y— yo| < B} bea 

neighborhood of the point (xg, yo) in the product X x Y of the spaces X and Y. 
Suppose that the mapping F : W — Z satisfies the following conditions: 


F (x0, yo) = 0; 

F(x, y) is continuous at (xo, yo); 

F'(x, y) is defined in W and continuous at (x0, yo); 
F i (x0, yo) is an invertible? transformation. 


at aaa a a 


Then there exists a neighborhood U = U(xo) of xo € X, a neighborhood V = 
V (yo) of yo € Y, and a mapping f :U — V such that: 


l. UxVCW; 


>That is, [FY (xo, yo)I“! € L(Z; Y). 
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2’. (F(x, y)=0inU x V) S (y= f(x), where x € U and f(x) € V); 
3". yo= fo); 


4’. f is continuous at xo. 


In essence, this theorem asserts that if the linear mapping F;, is invertible at a 
point (hypothesis 4), then in a neighborhood of this point the relation F(x, y) =0 
is equivalent to the functional dependence y = f (x) (conclusion 2’). 


Proof 1° To simplify the notation and obviously with no loss of generality, we may 
assume that x9 = 0, yo = 0, and consequently 


W={(x,y)eXxY | |x| <aAly| <p}. 
2° The main role in the proof is played by the auxiliary family of functions 


gx(y) = y — (F,(0,0))"' - F(x, y), (10.93) 


which depend on the parameter x € S, |x| <a, and are defined on the set {y € Y | 
ly] < B}. 

Let us discuss formula (10.93). We first determine whether the mappings g, are 
unambiguously defined and where their values lie. 

The mapping F is defined for (x, y) € W, and its value F(x, y) at the pair (x, y) 
lies in Z. The partial derivative F. : (x, y) at any point (x, y) € W, as we know, is a 
continuous linear mapping from Y into Z. 

By hypothesis 4 the mapping F. i (0,0) : Y + Z has a continuous inverse 
(FO, 0))~! : Z — Y. Hence the composition (FLO, 0))~! - F(x, y) really is de- 
fined, and its values lie in Y. : 

Thus, for any x in the w-neighborhood By (0, w) := {x € X | |x| < a} of the point 
0 € X, the function g, is a mapping g, : By(0, 8) — Y from the B-neighborhood 
By (0, B):={y € Y | |y| < B} of the point 0 € Y into Y. 

The connection of the mappings (10.93) with the problem of solving the equation 
F(x, y) =0 for y obviously consists of the following: the point y, is a fixed point 
of g, if and only if F(x, yy) = 0. 

Let us state this important observation firmly: 


ENS SS =O. (10.94) 


Thus, finding and studying the implicitly defined function y = y, = f (x) reduces 
to finding the fixed points of the mappings (10.93) and studying the way in which 
they depend on the parameter x. 

3° We shall show that there exists a positive number y < min{a, 6} such that for 
each x € X satisfying the condition |x| < y <a, the mapping g, : By(0, y) > Y of 
the ball By (0, y) := {y € Y | |y| < y < 6} into Y is a contraction with a coefficient 
of contraction that does not exceed, say 1/2. Indeed, for each fixed x € By (0, a@) 
the mapping g, : By (0, 6) > Y is differentiable, as follows from hypothesis 3 and 
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the theorem on differentiation of a composite mapping. Moreover, 


gi.(y) =ey — (FL, 0)) | - (Fix, y)) = 
= (F/(0,0)) | (F/(0,0) — Fi(x, y)). (10.95) 


By the continuity of F. if (x, y) at the point (0,0) (hypothesis 3), there exists a 
neighborhood {(x, y)—€ X x Y | |x| <y <aA|y| < y < B} of (0,0) e X x Yin 
which 


= 1 
Is] <1(O.0) "| -|0.9- FO,» <5. (10.96) 
2 
Here we are using the relation 
(F,(0,0))' €L(Z;¥),  thatis, || (F/@,0)) "|| <o0. 


Throughout the following we shall assume that |x| < y and |y| < y, so that 
estimate (10.96) holds. 

Thus, at any x € By(0,y) and for any yj, y2 € By(0, y), by the mean-value 
theorem, we indeed now find that 


1 
|gx (01) — 8x(¥2)| < sup [3G — yal < 5h — val (10.97) 


Eelyi.y2 


4°. In order to assert the existence of a fixed point y, for the mapping gy, we 
need a complete metric space that maps into (but not necessarily onto) itself under 
this mapping. 

We shall verify that for any ¢ satisfying 0 < e < y there exists 6 = d(e) in the 
open interval ]0, y[ such that for any x € By (0, 5) the mapping g, maps the closed 
ball g, (0, €) into itself, that is, ¢,(By (0, €)) C By (0, €). 

Indeed, we first choose a number 6 € ]0, y[ depending on ¢ such that 


= = 1 
|gx(O)| = | (F,0, 0)" - Fx, 0)| < | (FO,0) | |F@,0)| < 56 (10.98) 
for |x| <6. 
This can be done by hypotheses 1 and 2, which guarantee that F'(0, 0) = 0 and 


F(x, y) is continuous at (0, 0). 
Now if |x| < 6(€) < y and |y| < € < y, we find by (10.97) and (10.98) that 


1 1 
[gx] < [ax(v) — gx(0)] + [gx] < slyl + 58 <6 
and hence for |x| < 6(€) 


gx(By(0,e)) C By(0, €). (10.99) 
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Being a closed subset of the complete metric space Y, the closed ball By (0, ¢) is 
itself a complete metric space. 

5? Comparing relations (10.97) and (10.99), we can now assert by the fixed- 
point principle (Sect. 9.7) that for each x € By (0, 5(e)) =: U there exists a unique 
point y= y, =: f(x) € By(0,¢) =: V that is a fixed point of the mapping g, : 
By (0, é) — By (0, €). 

By the basic relation (10.94), it follows from this that the function f:U > V 
so constructed has property 2’ and hence also property 3’, since F(0,0) = 0 by 
hypothesis 1. 

Property 1’ of the neighborhoods U and V follows from the fact that, by con- 
struction, U x V C Bx(0,a@) x By (0, B) = W. 

Finally, the continuity of the function y = f(x) at x =0, that is, property 4’, 
follows from 2’ and the fact that, as was shown in part 4° of the proof, for every 
é€ > 0 (e < y) there exists d(€) > 0 (d(€) < y) such that gx (By (0, €)) C By (0, €) 
for any x € Bx (0, 5(e)), that is, the unique fixed point y, = f(x) of the mapping 
gx : By(0,€) > By (0, €) satisfies the condition | f (x)| < ¢ for |x| < 5(e). 


We have now proved the existence of the implicit function. We now prove a 
number of extensions of these properties of the function, generated by properties of 
the original function F’. 


Extension 1 (Continuity of the implicit function) [f in addition to hypotheses 2 
and 3 of the theorem it is known that the mappings F : W — Z and ae are contin- 
uous not only at the point (xo, yo) but in some neighborhood of this point, then the 
function f : U — V will be continuous not only at xo € U but in some neighborhood 
of this point. 


Proof By properties of the mapping L(Y; Z) > Ate Aq! € L(Z; Y) it follows from 
hypotheses 3 and 4 of the theorem (see Example 6 of Sect. 10.3) that at each point 
(x, y) in some neighborhood of (xo, yo) the transformation f/(x, y) € L(Y; Z) is 
invertible. Thus under the additional hypothesis that F is continuous all points (x, 7) 
of the form (x, f(x)) in some neighborhood of (xo, yo) satisfy hypotheses 1-4, 
previously satisfied only by the point (xo, yo). 

Repeating the construction of the implicit function in a neighborhood of these 
points (<, §), we would obtain a function y = f (x) that is continuous at ~ and by 2’ 
would coincide with the function y = f(x) in some neighborhood of x. But that 
means that f itself is continuous at x. 


Extension 2 (Differentiability of the implicit function) [fin addition to the hypothe- 
ses of the theorem it is known that a partial derivative F,.(x, y) exists in some neigh- 
borhood W of (xo, yo) and is continuous at (xq, yo), then the function y = f (x) is 
differentiable at xo, and 


fo) = —(Fi(x0, yo) - (Fi, yo))- (10.100) 
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Proof We verify immediately that the linear transformation L € £(X; Y) on the 
right-hand side of formula (10.100) is indeed the differential of the function y = 


f(x) at xg. 

As before, to simplify the notation, we shall assume that x9 = 0 and yo = 0, so 
that f(0) =0. 

We begin with a preliminary computation. 


|f@) — FO) — Lx| = 

=|f(x)-Lx|= 

=| F) + (Fy,0)" - (FO, 0))x| = 
=|(F/(0,0))'(F/(, O)x + F,, 0) f(x))| = 


= |(F,0,0))'(F(x, f(@)) — FO, 0) — F,0, 0)x — F/O, 0) f(x))| < 


IA 


|(F@, 0)! ||(F@, f£@) — FO, 0) — F,, 0)x — F, 0,0) f())| < 


|(F,0,0)) ‘|| a(x, £@)) (lal + | £09), 


A 


where a(x, y) > Oas (x, y) > (0,0). 

These relations have been written taking account of the relation F(x, f(x)) =0 
and the fact that the continuity of the partial derivatives F, and F. , at (0, 0) guaran- 
tees the differentiability of the function F(x, y) at that point. 

For convenience in writing we set a := ||L|| and b := ||(F,,(0, 0))~!]. 

Taking account of the relations 


| f)| = |f@) — Lx + Lx| <| f(x) — Lx| + [Lal <|f@) — Lx| + alex, 


we can extend the preliminary computation just done and obtain the relation 


iF 


| f(x) — Lx| < ba(x, f(x))((a+ Dix] +| fx) — Lx 


or 
(a+1)b 

— ba(x, f(x) 

Since f is continuous at x = 0 and f (0) = 0, we also have f(x) > 0 as x > 0, 


and therefore a(x, f(x)) > 0 as x > 0. 
It therefore follows from the last inequality that 


| f(x) — Lx| < ; a(x, f(x))Ial. 


| f(x) — f(0) — Lx] =|f(x) — Lx| =o(|x|) asx 0. 


Extension 3 (Continuous differentiability of the implicit function) If in addition to 
the hypotheses of the theorem it is known that the mapping F has continuous partial 
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derivatives F\. and rd in some neighborhood W of (xo, yo), then the function y = 
J (x) is continuously differentiable in some neighborhood of xo, and its derivative 
is given by the formula 


f'@=—(Fi(x, f@))7 + (F(x. F@)). (10.101) 


Proof We already know from formula (10.100) that the derivative f’(x) exists and 
can be expressed in the form (10.101) at an individual point x at which the transfor- 
mation F (x, f (x)) is invertible. 

It remains to be verified that under the present hypotheses the function f’(x) is 
continuous in some neighborhood of x = x9. 

The bilinear mapping (A, B) +» A- B — the product of linear transformations A 
and B —is a continuous function. 

The transformation B = —F/(x, f(x)) is a continuous function of x, being the 
composition of the continuous functions x (x, f(x)) RH —Fi(x, f(x)). 

The same can be said about the linear transformation A~! = F (x, f(x)). 

It remains only to recall (see Example 6 of Sect. 10.3) that the mapping A~! +> A 
is also continuous in its domain of definition. 

Thus the function f’(x) defined by formula (10.101) is continuous in some 
neighborhood of x = xo, being the composition of continuous functions. 


We can now summarize and state the following general proposition. 


Proposition /f in addition to the hypotheses of the implicit function theorem it 
is known that the function F belongs to the class C®(W, Z), then the function 
y = f (x) defined by the equation F (x, y) = 0 belongs to C (U, Y) in some neigh- 
borhood U of xo. 


Proof The proposition has already been proved for k = 0 and k = 1. The general 
case can now be obtained by induction from formula (10.101) if we observe that 
the mapping L(Y; Z) 3 At Aq! € L(Z; Y) is (infinitely) differentiable and that 
when Eq. (10.101) is differentiated, the right-hand side always contains a deriva- 
tive of f one order less than the left-hand side. Thus, successive differentiation of 
Eq. (10.101) can be carried out a number times equal to the order of smoothness of 
the function F’. 


In particular, if 
f'n =—(Fi(x, f@))) | = (F(x, f@)) an, 
then 


fF"), hg) = —d( Fi (x, f(x) na F(x, fe) — 


10.7. The General Implicit Function Theorem 103 


=(Fy(x, f@))) "dF, (x, fO))h2(Fy (x, £@))) | x 
x Fi(x, f@))a — (Fi(x, £0) x 
x (Fi £0) + Fi (% £@)) f/@)) hi) ho = 
=(Fy(x, FO) (RA (x, £00) + F(x, £0) f/G)ha) x 
x (F(x, F@))) Fe, f@)h1 — (Fiz, FD) x 
x (Fee. @)) + Fy (« £@)) f'@))hi)ha. 


In less detailed, but more readable notation, this means that 


Ff" x\(hni ha) = (Fy) [((Fye + Fy Jha) (Fy) eden — (Fee + Foy FY) ha}: 
(10.102) 
In this way one could theoretically obtain an expression for the derivative of an 
implicit function to any order; however, as can be seen even from formula (10.102), 
these expressions are generally too cumbersome to be conveniently used. Let us 
now see how these results can be made specific in the important special case when 
X=R”, Y =R’", and Z=R". 
In this case the mapping z = F(x, y) has the coordinate representation 


SP cy ti i), 
: (10.103) 
ae cs chtigh el wend y"). 


The partial derivatives F) € £(R™”; R”) and i ’ € £(R"; R”) of the mapping are 
defined by the matrices 


ar! aF! OFL |, art 
ax aah ¥ PP ay! ay” 
F’ = . ; F' = 
x : , y _ . , 
ar™ a? ar" OE? 
ax! oxm ay! ay” 


computed at the corresponding point (x, y). 

As we know, the condition that F' is and F - be continuous is equivalent to the 
continuity of all the entries of these matrices. 

The invertibility of the linear transformation F. (xo, yo) € LCR”; R”) is equiva- 
lent to the nonsingularity of the matrix that defines this transformation. 

Thus, in the present case the implicit function theorem asserts that if 


Pe nety o ann Se 
I) ; 


Pan yee a 


104 10 *Differential Calculus from a More General Point of View 


2) BOP once P ih eag Py i = 1,...,n, are continuous functions at the 
point Gite eee ee x R’; 

3) all the partial derivatives SC eet ten i =1,....2, j= 
1,...,n, are defined in a neighborhood of Was seers Was .++,Q) and are con- 


tinuous at this point; 
4) the determinant 


ayl ay 
oF” oF” 
ae? aye 
of the matrix F is nonzero at the point cae Lehadys Ves ..+, 9) then there ex- 


ist a neighborhood U of x9 = ca ...,X9') € R”, a neighborhood V of yo = 
(yd, ..., ¥9) € R", and a mapping f : U > V having a coordinate representation 


Pu = hae Cee 
: (10.104) 
yt = fig Carre ge 
such that 


1’) inside the neighborhood U x V of Gis Saas XO Vai ..+,¥9) € IR” x R" the 
system of equations 


Pe ok ay a0 


is equivalent to the functional relation f : U — V expressed by (10.104); 
2’) 


3’) the mapping (10.104) is continuous at Cea cree Vas woes Yo): 


If in addition it is known that the mapping (10.103) belongs to the class C™, 
then, as follows from the proposition above, the mapping (10.104) will also belong 
to C™, of course within its own domain of definition. 
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In this case formula (10.101) can be made specific, becoming the matrix equality 


-1 


af! af! oF ui, OE aF! aF! 

3x ae 7ym ay! ay" axl Sh bm ym 

af” af” oF” an oF” oF” ane oF” 

ax! Bee Se ox™ ay! dy" ax! ox 
in which the left-hand side is computed at (x!,..., x”) and the right-hand side 
at the corresponding point ea RD tng Pe where y’ = PO cog te 
i=l,...,n 


If n = 1, that is, when the equation 
FS cack 7) =0 


is being solved for y, the matrix F{ consists of a single entry — the number 


Cae ...,x’", y). In this case y = f(x!,...,x”), and 


af af aF\ !(aF oF 
(4 o)= (=) (Fa. Za). (10.105) 


In this case formula (10.102) also simplifies slightly; more precisely, it can be 
written in the following more symmetric form: 


(FY. een f Vail ie, + PF" f ho Fi hy 


f’(x)(Aq, h2) = 2 ss *—. (10.106) 
¥ 


And if n = 1 and m = 1, then y = f(x) is a real-valued function of one real 
argument, and formulas (10.105) and (10.106) simplify to the maximum extent, 
becoming the numerical equalities 


Dc ae 
EEA 


(Fo. + i, f BY = (Fv + rae af! )FY 


f'@= (Fi — (x,y) 


for the first two derivatives of the implicit function defined by the equation 
F(x, y)=0 


10.7.1 Problems and Exercises 


1. a) Assume that, along with the function f : U — Y given by the implicit func- 
tion theorem, we have a function ie U — Y defined in some neighborhood U of xo 
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and satisfying yo = i (xo) and F(x, a (x)) =Oin U. Prove that if a is continuous 
at xo, then the functions f and f are equal on some neighborhood of xo. 

b) Show that the assertion in a) is generally not true without the assumption that 
f is continuous at xo. 


2. Analyze once again the proof of the implicit function theorem and the extensions 
to it, and show the following. 


a) If z= F(x, y) is a continuously differentiable complex-valued function of 
the complex variables x and y, then the implicit function y = f(x) defined by the 
equation F(x, y) = 0 is differentiable with respect to the complex variable x. 

b) Under the hypotheses of the theorem X is not required to be a normed space, 
and may be any topological space. 


3. a) Determine whether the form f”(x)(h1, hz) defined by relation (10.102) is 
symmetric. 

b) Write the forms (10.101) and (10.102) for the case of numerical functions 
F(x!, x?, y) and F(x, a y?) in matrix form. 

c) Show that if Rath A(t) € £(R"; R”) is family of nonsingular matrices 
A(t) depending on the parameter f in an infinitely smooth manner, then 


dA ye eee ce Oe = ae 
—— =2A Mes A A, wWwhereA =A ‘(f) 


dt? dt? 
denotes the inverse of the matrix A = A(f). 


4. a) Show that Extension | to the theorem is an immediate corollary of the stabil- 
ity conditions for the fixed point of the family of contraction mappings studied in 
Sect. 9.7. 

b) Let {A; : X — X} be a family of contraction mappings of a complete normed 
space into itself depending on the parameter t, which ranges over a domain §2 in 
a normed space T. Show that if A;(x) = g(t, x) is a function of class C™(2 x 
X, X), then the fixed point x(t) of the mapping A, belongs to class C (2, X) as 
a function of f. 


5. a) Using the implicit function theorem, prove the following inverse function the- 
orem. 

Let g: G— X bea mapping from a neighborhood G of a point yo in a complete 
normed space Y into a normed space X. If 


1° the mapping x = g(y) is differentiable in G, 
2° g’(y) is continuous at yo, 
3° g’ (yo) is an invertible transformation, 


then there exists a neighborhood V C Y of yo and a neighborhood U C X of xo 
such that g: V > U is bijective, and its inverse mapping f : U — V is continuous 
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in U and differentiable at x9; moreover, 
-1 
f' (x0) = (g’GQ0)) 


b) Show that if it is known, in addition to the hypotheses given in a), that the 
mapping g belongs to the class C(V, U), then the inverse mapping f belongs to 
c™ (U,V). 

c) Let f : R” — R" be a smooth mapping for which the matrix f’(x) is non- 
singular at every point x € R” and satisfies the inequality ||(f’)~!(x)|| < C witha 
constant C that is independent of x. Show that f is a bijective mapping. 

d) Using your experience in solving c), try to give an estimate for the radius 
of a spherical neighborhood U = B(xo,r) centered at xo in which the mapping 
jf :U — V studied in the inverse function theorem is necessarily defined. 


6. a) Show that if the linear mappings A € L(X; Y) and B € £(X; R) are such that 
ker A C ker B (here ker, as usual, denotes the kernel of a transformation), then there 
exists a linear mapping 4 € L(Y; R), such that B=1- A. 


b) Let X and Y be normed spaces and f : X > R and g: X — Y smooth func- 
tions on X with values in R and Y respectively. Let S be the smooth surface defined 
in X by the equation g(x) = yo. Show that if x9 € S is an extremum of the function 
J \s, then any vector h tangent to S at Xo simultaneously satisfies two conditions: 
f'(xo)h =0 and g/(xo)h = 0. 

c) Prove that if x9 € S is an extremum of the function f|s then f’(xo) =A- 
g’ (xo), where A. € L(Y; R). 

d) Show how the classical Lagrange necessary condition for an extremum with 
constraint of a function on a smooth surface in R” follows from the preceding result. 


7. As is known, the equation z” + cyt b+. +c, =0 with complex coefficients 
has in general n distinct complex roots. Show that the roots of the equation are 
smooth functions of the coefficients, at least where all the roots are distinct. 

8. a) Following Hadamard, prove that a continuous locally invertible mapping f : 
R” — R” is globally invertible (i.e., it is bijective) if and only if f(x) > oo as 
x — oo. Convince yourself that we can consider here any normed space instead 
of IR”. How should we interpret (or reformulate) Hadamard’s conditions if we now 
consider the image of R” or a normed space under a homeomorphism? 


b) Let F : X x Y — Z be acontinuous mapping defined on the direct product of 
the normed spaces X and Y. Show that the equation F(x, y) = 0 is solvable glob- 
ally with respect to y (in the sense that the local continuous solution of y = f(x) 
extends as such to the whole space X) exactly when the following two conditions 
are fulfilled: the equation has a continuous solution in a neighborhood of every 
point (xo, yo) satisfying F'(xo, yo) = 0; and in the pair (x, y) satisfying the equa- 
tion F(x, y) = 0, the second coordinate can tend to infinity (changing continuously) 
only if the first coordinate in its space also tends to infinity. 
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c) Following John,° show that if a continuous locally invertible mapping f : 
B — H from the unit ball B to anormed space H is such that locally (at every point 
of the ball), it changes the element of length no more than k > | times (expanding 
or contracting), then in the ball of radius k~*, this mapping is injective. (Caution: 
an infinite-dimensional normed space can be isometrically embedded into itself as 
a proper subspace through a shift of coordinates, but this mapping is not invertible 
or locally invertible. It is invertible as a mapping only on its image.) 


®F John (1910-1994), German-born and later a famous American mathematician, student of 
R. Courant. 


Chapter 11 
Multiple Integrals 


11.1 The Riemann Integral over an n-Dimensional Interval 


11.1.1 Definition of the Integral 


a. Intervals in R” and Their Measure 


Definition 1 The set J = {x € R” | a! <x! <b',i=1,...,n} is called an interval 
or a coordinate parallelepiped in R" . 


If we wish to note that the interval is determined by the points a = (a!,..., a”) 
and b = (b!,...,b”), we often denote it Igy, or, by analogy with the one- 


dimensional case, we write itas a <x <b. 


Definition 2 To the interval J = {x € R” | ai<x'<bji=l,..., n} we assign the 
number |/| := | [/_, (b' — a’), called the volume or measure of the interval. 


The volume (measure) of the interval J is also denoted v(/) and (JZ). 


Lemma 1 The measure of an interval in R" has the following properties. 


a) It is homogeneous, that is, if AIq,p := Tna,rb, where X= 0, then 


|ALa,b| = A" |Ta,bl- 

b) It is additive, that is, if the intervals I, I,,..., Ix are such that I = Ui Tj 
and no two of the intervals I,,..., I, have common interior points, then |\I| = 
Dyer lUyl. 

c) If the interval I is covered by a finite system of intervals I),..., I, that is, 

k k 
Ic Uj=i Ij, then |I| < ae [Zj\. 

All these assertions follow easily from Definitions | and 2. 
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b. Partitions of an Interval and a Base in the Set of Partitions 


Suppose we are given an interval J = {x € R” | ai<x' <b i=1,. .., nm}. Par- 
titions of the coordinate intervals [a', b'], i= 1,...,n, induce a partition of the 
interval J into finer intervals obtained as the direct products of the intervals of the 
partitions of the coordinate intervals. 


Definition 3 The representation of the interval J (as the union J = Ue I; of finer 
intervals /;) just described will be called a partition of the interval T, and will be 
denoted by P. 


Definition 4 The quantity A(P) := max;<j<,d(/;) (the maximum among the di- 
ameters of the intervals of the partition P) is called the mesh of the partition P. 


Definition 5 If in each interval 7; of the partition P we fix a point &; € /;, we say 
that we have a partition with distinguished points. 


The set {&,...,&j}, as before, will be denoted by the single letter €, and the 
partition with distinguished points by (P, &). 

In the set P = {(P, &)} of partitions with distinguished points on an interval J we 
introduce the base A(P.) + 0 whose elements By(d > 0), as in the one-dimensional 
case, are defined by Bg := {(P,&) € P| A(P) < d}. 

The fact that 6 = {Bz} really is a base follows from the existence of partitions of 
mesh arbitrarily close to zero. 


c. Riemann Sums and the Integral 


Let f:1>Rbea real-valued! function on the interval J and P = {I),..., I} a 
partition of this interval with distinguished points € = {&,..., &}. 


Definition 6 The sum 


k 
of, P,6):=) > Gl 
i=l 
is called the Riemann sum of the function f corresponding to the partition of the 
interval J with distinguished points (P, é). 


Definition 7 The quantity 


[fear lim o(f, P,é), 
I A(P)>0 


‘Please note that in the following definitions one could assume that the values of f lie in any 
normed vector space. For example, it might be the space C of complex numbers or the spaces R” 
and C”. 
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provided this limit exists, is called the Riemann integral of the function f over the 
interval J. 


We see that this definition, and in general the whole process of constructing the 
integral over the interval 7 C R” is a verbatim repetition of the procedure of defining 
the Riemann integral over a closed interval of the real line, which is already familiar 
to us. To highlight the resemblance we have even retained the previous notation 
f(x) dx for the differential form. Equivalent, but more expanded notations for the 
integral are the following: 


Eyer or fof PO neta ae 
I 
fs 


n 


To emphasize that we are discussing an integral over a multidimensional domain 
I we say that this is a multiple integral (double, triple, and so forth, depending on 
the dimension of /). 


d. A Necessary Condition for Integrability 


Definition 8 If the finite limit in Definition 7 exists for a function f : 7 > R, then 
f is Riemann integrable over the interval [. 


We shall denote the set of all such functions by R(/). 
We now verify the following elementary necessary condition for integrability. 


Proposition 1 f ¢ RU) => f is bounded on I. 


Proof Let P be an arbitrary partition of the interval 7. If the function f is un- 
bounded on /, then it must be unbounded on some interval Jj, of the partition P. 
If (P, &’) and (P, &”) are partitions P with distinguished points such that &’ and &” 
differ only in the choice of the points &;, and &;", then 


lo(f, P,é') —o(f, Pye") | = | f(&,) - F(&)|Hiol- 


By changing one of the points € ip and &* ‘ , as aresult of the unboundedness of f 
in Jj), we could make the right-hand side of this equality arbitrarily large. By the 
Cauchy criterion, it follows from this that the Riemann sums of f do not have a 
limit as A(P) > 0. 


112 11 Multiple Integrals 


11.1.2 The Lebesgue Criterion for Riemann Integrability 


When studying the Riemann integral in the one-dimensional case, we acquainted the 
reader (without proof) with the Lebesgue criterion for the existence of the Riemann 
integral. We shall now recall certain concepts and prove this criterion. 


a. Sets of Measure Zero in R” 


Definition 9 A set E C R” has (n-dimensional) measure zero or is a set of measure 
zero (in the Lebesgue sense) if for every ¢ > 0 there exists a covering of E by an 
at most countable system {J;} of n-dimensional intervals for which the sum of the 
volumes )°; |Jj| does not exceed e. 


Lemma 2 a) A point and a finite set of points are sets of measure zero. 

b) The union of a finite or countable number of sets of measure zero is a set of 
measure Zero. 

c) A subset of a set of measure zero is itself of measure zero. 

d) A nondegenerate” interval Ta,b C R” is not a set of measure zero. 


The proof of Lemma 2 does not differ from the proof of its one-dimensional 
version considered in Sect. 6.1.3, paragraph d. Hence we shall not give the details. 


Example I The set of rational points in R” (points all of whose coordinates are 
rational numbers) is countable and hence is a set of measure zero. 


Example 2 Let f : I > R be a continuous real-valued function defined on an 
(n — 1)-dimensional interval J C R’~!. We shall show that its graph in R” is a 
set of n-dimensional measure zero. 


Proof Since the function f is uniformly continuous on J, for ¢ > 0 we find 6 > 0 
such that | f (x1) — f(x2)| < e for any two points x1, x2 € J such that |x; — x2| <6. 
If we now take a partition P of the interval J with mesh A(P) < 6, then on each 
interval J; of this partition the oscillation of the function is less than ¢. Hence, 
if x; is an arbitrary fixed point of the interval J;, the n-dimensional interval 7; = 
I, x lf (xi) —, f (x) +] obviously contains the portion of the graph of the function 
lying over the interval J;, and the union L); 1; covers the whole graph of the function 
over J. But 0; [7;|= >; [il -2e = 2e|1| (here |J;| is the volume of J; in R’~! and 
A | the volume of 7 in R”). Thus, by decreasing ¢, we can indeed make the total 
volume of the covering arbitrarily small. 


That is, an interval Tap = {x € R” | ai <x! <b',i =1,...,n} such that the strict inequality 
a’ <b! holds for eachi € {1,...,n}. 
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Remark 1 Comparing assertion b) in Lemma 2 with Example 2, one can conclude 
that in general the graph of a continuous function f : R”~! — R or a continuous 
function f : M — R, where M Cc R” —! is a set of n-dimensional measure zero 
in R”. 


Lemma 3 a) The class of sets of measure zero remains the same whether the in- 
tervals covering the set E in Definition 9, that is, E C |); li, are interpreted as an 
ordinary system of intervals {I;}, or in a stricter sense, requiring that each point of 
the set be an interior point of at least one of the intervals in the covering.” 

b) A compact set K in R” is a set of measure zero if and only if for every ¢ > 0 
there exists a finite covering of K by intervals the sum of whose volumes is less 
than &. 


Proof a) If {Jj} is a covering of E (that is, E Cc ; 1; and }°; |Ji| < e), then, re- 
placing each J; by a dilation of it from its center, which we denote i we obtain 
a system of intervals {Ti} such that >> 7; | < A”e, where A is a dilation coefficient 
that is the same for all intervals. If 4 > 1, it is obvious that the system iD, } will 
cover E in such a way that every point of E is interior to one of the intervals in the 
covering. 

b) This follows from a) and the possibility of extracting a finite covering from any 
open covering of a compact set K. (The system {I \alj } consisting of open intervals 
obtained from the system i } considered in a) may serve as such a covering.) 


b. A Generalization of Cantor’s Theorem 


We recall that the oscillation of a function f : E — R on the set E has been defined 
as w(f; E):= supy, ce |f (x1) — f(x2)|, and the oscillation at the point x € E as 
o(f;x) := lims.0 o(f; US (x)), where U2(x) is the 5-neighborhood of x in the 
set E. 


Lemma 4 /f the relation w(f;x) < wo holds at each point of a compact set K 
for the function f : K — R, then for every ¢ > 0 there exists 6 > 0 such that 
o(f; U2 (x)) < wo +6 for each point x € K. 


When wo = 0, this assertion becomes Cantor’s theorem on uniform continuity of 
a function that is continuous on a compact set. The proof of Lemma 4 is a verbatim 
repetition of the proof of Cantor’s theorem (Sect. 6.2.2) and therefore we do not take 
the time to give it here. 


3In other words, it makes no difference whether we mean closed or open intervals in Definition 9. 
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c. Lebesgue’s Criterion 


As before, we shall say that a property holds at almost all points of a set M or almost 
everywhere on M if the subset of M where this property does not necessarily hold 
has measure zero. 


Theorem 1 (Lebesgue’s criterion) f € RU) > (f is bounded on I) A (f is con- 
tinuous almost everywhere on I). 


Proof Necessity. If f € R(/), then by Proposition | the function f is bounded on J. 
Suppose | f| < M on I. 

We shall now verify that f is continuous at almost all points of 7. To do this, we 
shall show that if the set E of its points of discontinuity does not have measure zero, 
then f ¢ RU). 

Indeed, representing E in the form EF = I ae 1 En, where En, = {x € I | 
w(f;x) => 1/n}, we conclude from Lemma 2 that if E does not have measure zero, 
then there exists an index ng such that F,,, is also not a set of measure zero. Let P 
be an arbitrary partition of the interval 7 into intervals {J;}. We break the partition 
P into two groups of intervals A and B, where 


1 
A=|he PLN Em xON OS nz st. and B=P\A. 
no 


The system of intervals A forms a covering of the set E,,. In fact, each point 
of Ey, lies either in the interior of some interval J; € P, in which case obviously 
I; € A, or on the boundary of several intervals of the partition P. In the latter case, 
the oscillation of the function must be at least =o on at least one of these intervals 
(because of the triangle inequality), and that interval belongs to the system A. 

We shall now show that by choosing the set € of distinguished points in the 
intervals of the partition P in different ways we can change the value of the Riemann 
sum significantly. 

To be specific, we choose the sets of points &’ and &” such that in the intervals 
of the system B the distinguished points are the same, while in the intervals J; of 
the system A, we choose the points &/ and &/’ so that f (&/) — f (E/) > ae We then 
have 


lo(F P.8') —o(f, P.8")| = 


>. (F(&) — F(E/) 


1 
IjcgA 


IjEA 


The existence of such a constant c follows from the fact that the intervals of the 
system A form a covering of the set E,,,, which by hypothesis is not a set of measure 
zero. 

Since P was an arbitrary partition of the interval 7, we conclude from the Cauchy 
criterion that the Riemann sums o(f, P, €) cannot have a limit as A(P) — 0, that 


is, f RU). 
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Sufficiency. Let ¢ be an arbitrary positive number and FE, = {x € I | w(f; x) > e}. 
By hypothesis, E, is a set of measure zero. 


Moreover, E, is obviously closed in J, so that E, is compact. By Lemma 3 
there exists a finite system J|,..., J; of intervals in R” such that E, C = , 7; and 
yy [J;| < e. Let us set C; = aa J; and denote by Cz and C3 the unions of the 
intervals obtained from the intervals J; by dilation with center at the center of 7; and 
scaling factors 2 and 3 respectively. It is clear that E, lies strictly in the interior of C2 
and that the distance d between the boundaries of the sets Cz and C3 is positive. 

We note that the sum of the volumes of any finite system of intervals lying in C3, 
no two of which have any common interior points is at most 3”e, where n is the 
dimension of the space R”. This follows from the definition of the set C3 and prop- 
erties of the measure of an interval (Lemma 1). 

We also note that any subset of the interval J whose diameter is less than d is 
either contained in C3 or lies in the compact set K = I\(C2\0C2), where 0C2 is the 
boundary of Cz (and hence C2\0Cz2 is the set of interior points of C2). 

By construction E; C I\K, so that at every point x € K we must have 
w(f;x) < ¢. By Lemma 4 there exists 6 > 0 such that | f(x1) — f(x2)| < 2¢ for 
every pair of points x;, x2 € K whose distance from each other is at most 6. 

These constructions make it possible now to carry out the proof of the sufficient 
condition for integrability as follows. We choose any two partitions P’ and P” of 
the interval J with meshes 4.(P’) and A(P”) less than A = min{d, 5}. Let P be the 
partition obtained by intersecting all the intervals of the partitions P’ and P”, that 
is, in a natural notation, P = {Jjj = 1/ 1 j }. Let us compare the Riemann sums 
o(f, P,&) and o(f, P’,é’). Taking into account the equality |//| = PE [Jij|, we 
can write 


lof PE) oF, P.2)| =| (4) — FED) Eyl 


ij 


< AFG?) — f (&j)|iy| +> IF) — f &j)|lijl- 


= 


Here the first sum }>, contains the intervals of the partition P lying in the inter- 
vals I} of the partition P’ contained in the set C3, and the remaining intervals of P 
are included in the sum o> that is, they are all necessarily contained in K (after 
all, A(P) < d). 

Since | f| < M on J, replacing | f (€/) — f (&;)| in the first sum by 2M, we con- 
clude that the first sum does not exceed 2M - 3”e. 

Now, noting that H gj El j C K inthe second sum and A(P’) < 5, we conclude 
that | f (&/) — f (&ij)| < 2e, and consequently the second sum does not exceed 2¢|/|. 

Thus |o(f, P’,&)-—o(f, P, €)| < (2M -3” +. 2|7|)e, from which (in view of the 
symmetry between P’ and P’’), using the triangle inequality, we find that 


lo(f, P’,é') —o(f, P”.€")| <4(3"M + INhe 
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for any two partitions P’ and P” with sufficiently small mesh. By the Cauchy crite- 
rion we now conclude that f € R(/). 


Remark 2 Since the Cauchy criterion for existence of a limit is valid in any complete 
metric space, the sufficiency part of the Lebesgue criterion (but not the necessity 
part), as the proof shows, holds for functions with values in any complete normed 
vector space. 


11.1.3 The Darboux Criterion 


Let us consider another useful criterion for Riemann integrability of a function, 
which is applicable only to real-valued functions. 


a. Lower and Upper Darboux Sums 


Let f be a real-valued function on the interval J and P = {J;} a partition of the 
interval J. We set 
m; = inf f(x), M; = sup f (x). 


xel; xelj 
Definition 10 The quantities 


s(f,P)=) milf] and S(f,P)= >> MILI 


I 


are called the lower and upper Darboux sums of the function f over the interval J 
corresponding to the partition P of the interval. 


Lemma 5 The following relations hold between the Darboux sums of a function 
f:Il-R: 


a) s(f, P) =infgo(f, P,€) <o(f, P,&) < supz o(f, P,€) = S(f, P); 

b) if the partition P' of the interval I is obtained by refining intervals of the 
partition P, then s(f, P) <s(f, P’) < S(f, P) < SU, P); 

c) the inequality s(f, P\) < S(f, P2) holds for any pair of partitions P, and P 
of the interval I. 


Proof Relations a) and b) follow immediately from Definitions 6 and 10, taking 
account, of course, of the definition of the greatest lower bound and least upper 
bound of a set of numbers. 

To prove c) it suffices to consider the auxiliary partition P obtained by intersect- 
ing the intervals of the partitions P; and P). The partition P can be regarded as a 
refinement of each of the partitions P; and P, so that b) now implies 


s(f, Pir) <s(f, P) <= SCF, P) < Sf, Pa). 
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b. Lower and Upper Integrals 


Definition 11 The /ower and upper Darboux integrals of the function f: 7 —> R 
over the interval J are respectively 


J =sups(f, P), J = int SCF, P), 
P 
where the supremum and infimum are taken over all partitions P of the interval /. 


It follows from this definition and the properties of Darboux sums exhibited in 
Lemma 3 that the inequalities 


si Pyed =F <SG.P) 


hold for any partition P of the interval. 


Theorem 2 (Darboux) For any bounded function f : I > R, 
4 oii P li P)=7); 
(3, lim |s(fP)) A(, lim s(f P)=J); 
4 ii - li y= 7): 
(3, um SUP) A (dim SP) =J) 


Proof If we compare these assertions with Definition 11, it becomes clear that in 
essence all we have to prove is that the limits exist. We shall verify this for the lower 
Darboux sums. 

Fix e > 0 and a partition P, of the interval I for which s(f; P.) > J — €. Let 
I; be the set of points of the interval J lying on the boundary of the intervals of the 
partition P,. As follows from Example 2, I; is a set of measure zero. Because of 
the simple structure of I, it is even obvious that there exists a number A, such that 
the sum of the volumes of those intervals that intersect I, is less than ¢ for every 
partition P such that A(P) <Ag. 

Now taking any partition P with mesh A(P) < A,, we form an auxiliary partition 
P’ obtained by intersecting the intervals of the partitions P and P,. By the choice 
of the partition P, and the properties of Darboux sums (Lemma 5), we find 


J—e<s(f, Pe) <s(f, P') < JT. 


We now remark that the sums s(f, P’) and s(f, P) both contain all the terms 
that correspond to intervals of the partition P that do not meet I. Therefore, if 
| f(x)| < M on J, then 


|s(f, P’) — s(f, P)| <2Me 


and taking account of the preceding inequalities, we thereby find that for A(P) <A, 
we have the relation 


JI —s(f, P)< 2M + le. 
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Comparing the relation just obtained with Definition 11, we conclude that the limit 
lim, p)+0 5(f, P) does indeed exist and is equal to 7. 
Similar reasoning can be carried out for the upper sums. 


c. The Darboux Criterion for Integrability of a Real- Valued Function 


Theorem 3 (The Darboux criterion) A real-valued function f : I > R defined on 
an interval I C R" is integrable over that interval if and only if it is bounded on I 


and its upper and lower Darboux integrals are equal. 
Thus, 


fEeRU) <= (CF is bounded on NAIZ=T); 


Proof Necessity. If f € R(/), then by Proposition | the function f is bounded on J. 
It follows from Definition 7 of the integral, Definition 11 of the quantities 7 and 7, 
and part a) of Lemma 5 that in this case 7 = Fi: 


Sufficiency. Since s(f, P) <a(f, P,€) < S(f, P) when J = J, the extreme terms 
in these inequalities tend to the same limit by Theorem 2 as A(P) — 0. Therefore 
o(f, P,&) has the same limit as A(P) > 0. 


Remark 3 It is clear from the proof of the Darboux criterion that if a function is 
integrable, its lower and upper Darboux integrals are equal to each other and to the 
integral of the function. 


11.1.4 Problems and Exercises 


1. a) Show that a set of measure zero has no interior points. 

b) Show that not having interior points by no means guarantees that a set is of 
measure zero. 

c) Construct a set having measure zero whose closure is the entire space R”. 

d) Aset E C J is said to have content zero if for every ¢ > O it can be covered 
by a finite system of intervals [), ..., 7; such that am 1 il < e. Is every bounded 
set of measure zero a set of content zero? 

e) Show that if a set E C R” is the direct product R x e of the line R and a set 
e CR"! of (n — 1)-dimensional measure zero, then E is a set of n-dimensional 
measure zero. 


2. a) Construct the analogue of the Dirichlet function in R” and show that a 
bounded function f : 7 — R equal to zero at almost every point of the interval / 
may still fail to belong to R(/). 

b) Show that if f ¢ R(Z) and f(x) =0, at almost all points of the interval /, 
then f; f(x) dx =0. 
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3. There is a small difference between our earlier definition of the Riemann inte- 
gral on a closed interval J C R and Definition 7 for the integral over an interval 
of arbitrary dimension. This difference involves the definition of a partition and the 
measure of an interval of the partition. Clarify this nuance for yourself and verify 
that 


b 
/ fodr= f fear, ifa<b 
a I 


and 


b 
/ fade == f fear, ifa>b, 
a I 


where J is the interval on the real line R with endpoints a and b. 
4. a) Prove that a real-valued function f : J — R defined on an interval J C R” is 
integrable over that interval if and only if for every ¢ > 0 there exists a partition P 
of J such that S(f; P) —s(f; P) <e. 

b) Using the result of a) and assuming that we are dealing with a real-valued 
function f : J — R, one can simplify slightly the proof of the sufficiency of the 
Lebesgue criterion. Try to carry out this simplification by yourself. 


11.2 The Integral over a Set 


11.2.1 Admissible Sets 


In what follows we shall be integrating functions not only over an interval, but also 
over other sets in R” that are not too complicated. 


Definition 1 A set E C R” is admissible if it is bounded in R” and its boundary is 
a set of measure zero (in the sense of Lebesgue). 


Example I A cube, a tetrahedron, and a ball in R? (or R”) are admissible sets. 


Example 2 Suppose the functions g; : 1 > R, i = 1,2, defined on an (n — 1)- 
dimensional interval J Cc R” are such that g(x) < g2(x) at every point x € J. If 
these functions are continuous, Example 2 of Sect. 11.1 makes it possible to assert 
that the domain in R” bounded by the graphs of these functions and the cylindrical 
lateral surface lying over the boundary 0/ of J is an admissible set in R”. 


We recall that the boundary 0 £ of a set E C R” consists of the points x such that 
every neighborhood of x contains both points of E and points of the complement of 


E in R”. Hence we have the following lemma. 


Lemma 1 For any sets E, E,, Ez C R", the following assertions hold: 
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a) 0E is aclosed subset of R"; 
b) 0(E, U Ex) CAE, VOEd; 
c) 0(E, 9 Er) C0E| VOEd; 
d) 0(E\\E2) C OF, UOEd. 


This lemma and Definition | together imply the following lemma. 


Lemma 2 The union or intersection of a finite number of admissible sets is an ad- 
missible set; the difference of admissible sets is also an admissible set. 


Remark 1 For an infinite collection of admissible sets Lemma 2 is generally not 
true, and the same is the case with assertions b) and c) of Lemma 1. 


Remark 2 The boundary of an admissible set is not only closed, but also bounded 
in R”, that is, it is a compact subset of R”. Hence by Lemma 3 of Sect. 11.1, it can 
even be covered by a finite set of intervals whose total content (volume) is arbitrarily 
close to zero. 


We now consider the characteristic function 


wall free. 
XB 10, ifx¢ E, 


of an admissible set E. Like the characteristic function of any set E, the function 
x«(x) has discontinuities at the boundary points of the set E' and at no other points. 
Hence if E is an admissible set, the function x ¢ (x) is continuous at almost all points 
of R”. 


11.2.2 The Integral over a Set 


Let f be a function defined on a set E. We shall agree, as before, to denote the 
function equal to f(x) for x € E and to 0 outside E by fxx(x) (even though f 
may happen to be undefined outside of E). 


Definition 2 The integral of f over E is given by 


: fdr = / ore 
E IDE 


where / is any interval containing E. 


If the integral on the right-hand side of this equality does not exist, we say that f 
is (Riemann) nonintegrable over E. Otherwise f is (Riemann) integrable over E. 
The set of all functions that are Riemann integrable over E will be denoted R(E). 
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Definition 2 of course requires some explanation, which is provided by the fol- 
lowing lemma. 


Lemma 3 /f I, and In are two intervals, both containing the set E, then the inte- 
grals 


/ fxE(x)dx and / fxE(x) dx 
Iq In 
either both exist or both fail to exist, and in the first case their values are the same. 


Proof Consider the interval J = 1; M Jp. By hypothesis J D> E. The points of dis- 
continuity of fx are either points of discontinuity of f on E, or the result of 
discontinuities of xf, in which case they lie on dF. In any case, all these points 
lie in J = I; N In. By Lebesgue’s criterion (Theorem | of Sect. 11.1) it follows that 
the integrals of fxr over the intervals 7, /;, and J) either all exist or all fail to 
exist. If they do exist, we may choose partitions of 7, /;, and /> to suit ourselves. 
Therefore we shall choose only those partitions of 7; and J2 obtained as extensions 
of partitions of J = 1, M Jy. Since the function is zero outside 7, the Riemann sums 
corresponding to these partitions of 7; and J reduce to Riemann sums for the cor- 
responding partition of J. It then results from passage to the limit that the integrals 
over J and J, are equal to the integral of the function in question over J. 


Lebesgue’s criterion (Theorem | of Sect. 11.1) for the existence of the integral 
over an interval and Definition 2 now imply the following theorem. 


Theorem 1 A function f : E > R is integrable over an admissible set if and only 
if it is bounded and continuous at almost all points of E. 


Proof Compared with f, the function fx may have additional points of discon- 
tinuity only on the boundary dE of FE, which by hypothesis is a set of measure 
zero. 


11.2.3: The Measure (Volume) of an Admissible Set 
Definition 3 The (Jordan) measure or content of a bounded set E C R” is 


we)= | 1-dx, 
E 


provided this Riemann integral exists. 


Since 


/ iedx= | xe(e)dr, 
E IDE 
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and the discontinuities of x¢ form the set dE, we find by Lebesgue’s criterion that 
the measure just introduced is defined only for admissible sets. 

Thus admissible sets, and only admissible sets, are measurable in the sense of 
Definition 3. 

Let us now ascertain the geometric meaning of j(£). If E is an admissible set 
then 


wey= | xe ar= f_ xe(yar= | XE(x) dx, 
IDE IDE IDE 


where the last two integrals are the upper and lower Darboux integrals respectively. 
By the Darboux criterion for existence of the integral (Theorem 3) the measure 
LL(E) of a set is defined if and only if these lower and upper integrals are equal. 
By the theorem of Darboux (Theorem 2 of Sect. 11.1) they are the limits of the 
upper and lower Darboux sums of the function xg corresponding to partitions P 
of 7. But by definition of xz the lower Darboux sum is the sum of the volumes 
of the intervals of the partition P that are entirely contained in E (the volume of a 
polyhedron inscribed in EF), while the upper sum is the sum of the volumes of the 
intervals of P that intersect E (the volume of a circumscribed polyhedron). Hence 
[L(E) is the common limit as A4(P) — 0 of the volumes of polyhedra inscribed in 
and circumscribed about F, in agreement with the accepted idea of the volume of 
simple solids E Cc R”. 
For n = | content is usually called length, and for n = 2 it is called area. 


Remark 3 Let us now explain why the measure j.(£) introduced in Definition 3 is 
sometimes called Jordan measure. 


Definition 4 A set E C R” is a set of measure zero in the sense of Jordan or a set 
of content zero if for every ¢ > 0 it can be covered by a finite system of intervals 
I,,..., J, such that aa [Li] <e. 


Compared with measure zero in the sense of Lebesgue, a requirement that the 
covering be finite appears here, shrinking the class of sets of Lebesgue measure 
zero. For example, the set of rational points is a set of measure zero in the sense of 
Lebesgue, but not in the sense of Jordan. 

In order for the least upper bound of the contents of polyhedra inscribed in a 
bounded set E to be the same as the greatest lower bound of the contents of poly- 
hedra circumscribed about E (and to serve as the measure jz(F) or content of £), it 
is obviously necessary and sufficient that the boundary 0 E of E have measure 0 in 
the sense of Jordan. That is the motivation for the following definition. 


Definition 5 A set E is Jordan-measurable if it is bounded and its boundary has 
Jordan measure zero. 


As Remark 2 shows, the class of Jordan-measurable subsets is precisely the class 
of admissible sets introduced in Definition |. That is the reason the measure (EF) 


11.2 The Integral over a Set 123 


defined earlier can be called (and is called) the Jordan measure of the (Jordan- 
measurable) set E. 


11.2.4 Problems and Exercises 


1. a) Show that if a set E C R” is such that 4(£) = 0, then the relation 4(E) = 0 
also holds for the closure E of the set. 

b) Give an example of a bounded set E of Lebesgue measure zero whose closure 
E is nota set of Lebesgue measure zero. 

c) Determine whether assertion b) of Lemma 3 in Sect. 11.1 should be under- 
stood as asserting that the concepts of Jordan measure zero and Lebesgue measure 
zero are the same for compact sets. 

d) Prove that if the projection of a bounded set E C R” onto a hyperplane R"~! 
has (n — 1)-dimensional measure zero, then the set E itself has n-dimensional mea- 
sure zero. 

e) Show that a Jordan-measurable set whose interior is empty has measure 0. 


2. a) Is it possible for the integral of a function f over a bounded set E, as intro- 
duced in Definition 2, to exist if EF is not an admissible (Jordan-measurable) set? 

b) Is a constant function f : E — R integrable over a bounded but Jordan- 
nonmeasurable set E'? 

c) Is it true that if a function f is integrable over E, then the restriction f|A of 
this function to any subset A C E is integrable over A? 

d) Give necessary and sufficient conditions on a function f : E > R defined on 
a bounded (but not necessarily Jordan-measurable) set E under which the Riemann 
integral of f over E exists. 


3. a) Let E bea set of Lebesgue measure 0 and f : E > R a bounded continuous 
function on E. Is f always integrable on E? 

b) Answer question a) assuming that F is a set of Jordan measure zero. 

c) What is the value of the integral of the function f in a) if it exists? 


4. The Brunn—Minkowski inequality. Given two nonempty sets A, B C R”, we form 
their (vector) sum in the sense of Minkowski A+ B:= {a+b|aeA,be B}. Let 
V(E) denote the content of a set E C R”. 


a) Verify thatif A and B are standard n-dimensional intervals (parallelepipeds), 
then 


Vi"(A+ B)>V"(A) + V"(B). 


b) Now prove the preceding inequality (the Brunn—Minkowski inequality) for 
arbitrary measurable compact sets A and B. 

c) Show that equality holds in the Brunn—Minkowski inequality only in the fol- 
lowing three cases: when V(A + B) = 0, when A and B are singleton (one-point) 
sets, and when A and B are similar convex sets. 
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11.3 General Properties of the Integral 


11.3.1 The Integral as a Linear Functional 


Proposition 1 a) The set R(E) of functions that are Riemann-integrable over a 
bounded set E C R" is a vector space with respect to the standard operations of 
addition of functions and multiplication by constants. 

b) The integral is a linear functional 


i :>R(E)—>R _ on the set R(E). 
E 


Proof Noting that the union of two sets of measure zero is also a set of measure 
zero, we see that assertion a) follows immediately from the definition of the integral 
and the Lebesgue criterion for existence of the integral of a function over an interval. 

Taking account of the linearity of Riemann sums, we obtain the linearity of the 
integral by passage to the limit. 


Remark I If we recall that the limit of the Riemann sums as 4(P) — O must be the 
same independently of the set of distinguished points €, we can conclude that 


(f E R(E)) /\(f@) = 0 almost everywhere on E) => (/ f(x)dx = 0), 
E 


Therefore, if two integrable functions are equal at almost all points of FE, then 
their integrals over E are also equal. Hence if we pass to the quotient space of 
R(E) obtained by identifying functions that are equal at almost all points of E, we 
obtain a vector space R(E ) on which the integral is also a linear function. 


11.3.2 Additivity of the Integral 


Although we shall always be dealing with admissible sets E C R”, this assumption 
was dispensable in Sect. 11.3.1 (and we dispensed with it). From now on we shall 
be talking only of admissible sets. 


Proposition 2 Let E; and E2 be admissible sets in R" and f a function defined on 
E, UE». 


a) The following relations hold: 


(2 [tas S (af, f(s) dr) A(a[, teoar) 


=3f f(x) dx. 
E\NE2 
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b) If in addition it is known that WCE, M Er) = 0, the following equality holds 
when the integrals exist: 


i fsyde= [ flxyde + | f(x) dx. 
E\UE2 E| Eo 


Proof Assertion a) follows from Lebesgue’s criterion for existence of the Riemann 
integral over an admissible set (Theorem | of Sect. 11.2). Here it is only necessary 
to recall that the union and intersection of admissible sets are also admissible sets 
(Lemma 2 of Sect. 11.2). 

To prove b) we begin by remarking that 


XE\UE. = XE, (x) + XE(x) _ XE\NE> (x). 


Therefore, 


/ f(x) dx = S XE\UEy (x) dx = 
E\ UE, IDE\VE2 


= | fre odes f fretndr f frene(ax= 


= fdr + | f(x) dx. 
Ey E> 


The essential point is that the integral 


i pieced i Fax, 
I E\NE> 


as we know from part a), exists; and since w(E, M E2) = 0, it equals zero (see 
Remark 1). 


11.3.3 Estimates for the Integral 


a. A General Estimate 


We begin with a general estimate of the integral that is also valid for functions with 
values in any complete normed space. 


Proposition 3 [f f € R(E), then | f| € R(E), and the inequality 


/ ore < | Lf) dx 
E E 


holds. 
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Proof The relation | f| € R(£) follows from the definition of the integral over a set 
and the Lebesgue criterion for integrability of a function over an interval. 

The inequality now follows from the corresponding inequality for Riemann sums 
and passage to the limit. 


b. The Integral of a Nonnegative Function 

The following propositions apply only to real-valued functions. 

Proposition 4 The following implication holds for a function f : E > R: 
(f €R(E)) A (Vx € E (f(x) =0)) > [ f(x) dx = 0. 


Proof Indeed, if f(x) > 0 on E, then f xyz(x) > 0 in R”. Then, by definition, 


/ F(x)dx =f reese 
E IDE 


This last integral exists by hypothesis. But it is the limit of nonnegative Riemann 
sums and hence nonnegative. 


From Proposition 4 just proved, we obtain successively the following corollaries. 


Corollary 1 
(heeR@) At seone>(f soars ear), 


Corollary 2 [f f € R(E) and the inequalities m < f(x) < M hold at every point 
of the admissible set E, then 


mu(E) < / f(x) dx < Mu(E). 
E 


Corollary 3 If f € R(E), m=infyer f(x), and M =sup,ef f(x), then there is a 
number 0 € [m, M] such that 


/ f(x)dx =Ou(E). 
E 


Corollary 4 [f E is a connected admissible set and the function f € R(E) is con- 
tinuous, then there exists a point € € E such that 


[ tooax= FE) UE). 
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Corollary 5 [f in addition to the hypotheses of Corollary 2 the function g € R(E) 
is nonnegative on E, then 


m | soars [ fecnax sm [ g(x) dx. 
E E E 


Corollary 4 is a generalization of the one-dimensional result and is usually called 
by the same name, that is, the mean-value theorem for the integral. 


Proof Corollary 5 follows from the inequalities mg(x) < f(x)g(x) < Mg(x) tak- 
ing account of the linearity of the integral and Corollary 1. It can also be proved 
directly by passing from integrals over E to the corresponding integrals over an in- 
terval, verifying the inequalities for the Riemann sums, and then passing to the limit. 
Since all these arguments were carried out in detail in the one-dimensional case, we 
shall not give the details. We note merely that the integrability of the product f - g 
of the functions f and g obviously follows from Lebesgue’s criterion. 


We shall now illustrate these relations in practice, using them to verify the fol- 
lowing very useful lemma. 


Lemma a) /f the integral of a nonnegative function f : I > R over the interval I 
equals zero, then f (x) =0 at almost all points of the interval I. 

b) Assertion a) remains valid if the interval I in it is replaced by any admissible 
(Jordan-measurable) set E. 


Proof By Lebesgue’s criterion the function f € 7(£) is continuous at almost all 
points of the interval 7. For that reason the proof of a) will be achieved if we show 
that f(a) = 0 at each point of continuity a € I of the function f. 

Assume that f(a) > 0. Then f(x) > c > 0 in some neighborhood U;(a) of a 
(the neighborhood may be assumed to be an interval). Then, by the properties of the 
integral just proved, 


/ fode= [flare +f f(r)dx > / fe) dx > cu(U;(@) > 0. 
I Ur(a) I\U7(a) U; (a) 


This contradiction verifies assertion a). If we apply this assertion to the func- 
tion f x¢ and take account of the relation j4(0 E) = 0, we obtain assertion b). 


Remark 2 It follows from the lemma just proved that if E is a Jordan-measurable 
set in R” and R(E ) is the vector space considered in Remark 1, consisting of equiv- 
alence classes of functions that are integrable over EF and differ only on sets of 
Lebesgue measure zero, then the quantity || f || = fe | f|(x) dx is a norm on R(E). 


Proof Indeed, the inequality f f\f\(x)dx = 0 now implies that f is in the same 
equivalence class as the identically zero function. 
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11.3.4 Problems and Exercises 


1. Let E be a Jordan-measurable set of nonzero measure, f : E — Ra continuous 
nonnegative integrable function on E, and M = sup,er f(x). Prove that 


1/n 
lim (/ "(aya = M. 
n>o\ Jr 


2. Prove that if f, g € R(£), then the following are true. 


1/p 1/q 
<(f fl?) ax) (/ sl") ax) 
E E 


where p>1,q>1,and5+/=1; 
b) Minkowski’s inequality 


l/p 1/p 1/p 
() +l? dx) <(f Lf?) dr) +(f sl") ax) . 
E E E 


if p> 1. 

Show that 

c) the preceding inequality reverses direction if 0 < p < 1; 

d) equality holds in Minkowski’s inequality if and only if there exists 2 > 0 such 
that one of the equalities f = Ag or g =Af holds except on a set of measure zero 
in E; 

e) the quantity || f |p = (an Sie \f\? (x) dx)!/?, where u(E) > 0, is a mono- 


a) Hélder’s inequality 


i (f -e)(x)dx 
E 


tone function of p € R and is a norm on the space R(E) for p> 1. 
Find the conditions under which equality holds in Hélder’s inequality. 


3. Let E be a Jordan-measurable set in R” with w(E) > 0. Verify that if g € 
C(E,R) and f :R— R is a convex function, then 


1 1 
— d. —- fe) dx. 
(Se [ omar) se frewoas 


4. a) Show that if £ is a Jordan-measurable set in R” and the function f: E> R 
is integrable over E and continuous at an interior point a € E, then 


f(x) dx = f(a), 


lim 5a 
b> +0 w(UsE (a)) Us(a) 


where, as usual, ue (a) is the 5-neighborhood of the point in E. 
b) Verify that the preceding relation remains valid if the condition that a is an 
interior point of EF is replaced by the condition ~(U : (a)) > 0 for every 5 > 0. 
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11.4 Reduction of a Multiple Integral to an Iterated Integral 


11.4.1 Fubini’s Theorem 


Up to now, we have discussed only the definition of the integral, the conditions 
under which it exists, and its general properties. In the present section we shall 
prove Fubini’s theorem,* which, together with the formula for change of variable, is 
a tool for computing multiple integrals. 


Theorem ° Let X x Y be an interval in R"*", which is the direct product of inter- 


vals X CR” and Y C R". If the function f : X x Y > R is integrable over X x Y, 
then all three of the integrals 


i! fle, y) dedy, [ef fone. [wf fe, Dae 
XxY xX Y Y xX 


exist and are equal. 


Before taking up the proof of this theorem, let us decode the meaning of the sym- 
bolic expressions that occur in the statement of it. The integral /- xxy fy) dx dy 
is the integral of the function f over the set X x Y, which we are familiar 
with, written in terms of the variables x € X and y € Y. The iterated integral 
£ x dx : y J (x, y) dy should be understood as follows: For each fixed x € X the in- 
tegral F(x) = Be f(x, y) dy is computed, and the resulting function F : X ~ R 
is then to be integrated over X. If, in the process, the integral /, y f(x, y) dy does 
not exist for some x € X, then F(x) is set equal to any value between the lower 
and upper Darboux integrals (x) = fp f(x, y) dy and J(x) = fy f(x, y) dy, in- 
cluding the upper and lower integrals 7 (x) and J (x) themselves. It will be shown 
that in that case F € R(X). The iterated integral /y dy fy f(x, y) dx has a similar 
meaning. 

It will become clear in the course of the proof that the set of values of x € X at 
which 7 (x) 4 7 (x) is a set of m-dimensional measure zero in X. 

Similarly, the set of y € Y at which the integral x f(x, y) dx may fail to exist 
will turn out to be a set of n-dimensional measure zero in Y. 

We remark finally that, in contrast to the integral over an (m + n)-dimensional 
interval, which we previously agreed to call a multiple integral, the successively 


4G. Fubini (1870-1943) — Italian mathematician. His main work was in the area of the theory of 
functions and geometry. 


5This theorem was proved long before the theorem known in analysis as Fubini’s theorem, of which 
it is a special case. However, it has become the custom to refer to theorems making it possible to 
reduce the computation of multiple integrals to iterated integrals in lower dimensions as theorems 
of Fubini type, or, for brevity, Fubini’s Theorem. 
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computed integrals of the function f(x, y) over Y and then over X or over X and 
then over Y are customarily called iterated integrals of the function. 

If X and Y are closed intervals on the line, the theorem stated here theoreti- 
cally reduces the computation of a double integral over the interval X x Y to the 
successive computation of two one-dimensional integrals. It is clear that by apply- 
ing this theorem several times, one can reduce the computation of an integral over 
a k-dimensional interval to the successive computation of k one-dimensional inte- 
grals. 

The essence of the theorem we have stated is very simple and consists of the 
following. Consider a Riemann sum di. . f (xi, yj)|Xil - |¥;| corresponding to a 
partition of the interval X x Y into intervals X; x Y;. Since the integral over the 
interval X x Y exists, the distinguished points &;; can be chosen as we wish, and we 
choose them as the “direct product” of choices x; € X; C X and yj € Yj ¢ Y. We 
can then write 


SPOR a =>" ed Pee yAlgl= > WD FOR 
i,j i j J i 


and this is the prelimit form of theorem. 
We now give the formal proof. 


Proof Every partition P of the interval X x Y is induced by corresponding partitions 
Px and Py of the intervals X and Y. Here every interval of the partition P is the 
direct product X; x Yj; of certain intervals X; and Y; of the partitions Py and Py 
respectively. By properties of the volume of an interval we have |X; x Y;| =|X;i f 
|Y;|, where each of these volumes is computed in the space R”*”, R”, or R" i 
which the interval in question is situated. 

Using the properties of the greatest lower bound and least upper bound and the 
definition of the lower and upper Darboux sums and integrals, we now carry out the 
following estimates: 


s(f.P) => int fox, y)IXi x Yjl-s dX int (ig Fs »HEj1) Xi < 


i,j pee 
= int ([ 46. dy) <0 inf F@IXiI < 
i 


< > sup F(x)|Xi| <)> sup ([ f(x, yay IX |< 


j YEX i XEXi 


<)> sup (x sup F(x, y)I¥j ix |< 


; xEX; j yey; 


shag y)|Xi x Y;|=S(f, P). 
re 
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Since f € R(X x Y), both of the extreme terms in these inequalities tend to the 
value of the integral of the function over the interval X x Y as A(P) — 0. This fact 
enables us to conclude that F € R(X) and that the following equality holds: 


/ fle. drdy = f F(x) dx. 
XxY xX 


We have carried out the proof for the case when the iterated integration is carried 
out first over Y, then over X. It is clear that similar reasoning can be used in the case 
when the integration over X is done first. 


11.4.2: Some Corollaries 


Corollary 1 If f € R(X x Y), then for almost all x € X (in the sense of Lebesgue) 
the integral iy Ft (x, y) dy exists, and for almost all y € Y the integral ile F(x, y) dx 
exists. 


Proof By the theorem just proved, 


[([tonar- [ ro.»ay) ar=o. 
Xx Y Y 


But the difference of the upper and lower integrals in parentheses is nonnegative. 
We can therefore conclude by the lemma of Sect. 11.3 that this difference equals 
zero at almost all points x € X. 

Then by the Darboux criterion (Theorem 3 of Sect. 11.1) the integral yJf (x, y) dy 
exists for almost all values of x € X. 

The second half of the corollary is proved similarly. 


Corollary 2 [f the interval I C R” is the direct product of the closed intervals I; = 
fa’, b'],i=1,...,n, then 


pb” pr-! b} 
[ seoae | dx” deat Fa cee” UR 
I a” a 


qn! 1 


Proof This formula obviously results from repeated application of the theorem just 
proved. All the inner integrals on the right-hand side are to be understood as in 
the theorem. For example, one can insert the upper or lower integral sign through- 
out. 


Example I Let f(x, y, z) = zsin(x + y). We shall find the integral of the restriction 
of this function to the interval 7 C R? defined by the relations O <x <a, |y| < 7/2, 
O<z<l. 
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By Corollary 2 


1 m/2 cs 
[ff fensavayac= f a: | ay [ zsin(x + y)dx = 
I 0 —n/2 0 


1 x/2 
= / az | (—z cos(x + y) 9) dy= 
0 -n/2 


1 n/2 
a az | 2zcosydy = 
0 —x/2 


1 1 
_ : y= /2 _ _ 
= i (2z siny| oo) d= [ 4zdz = 2. 


The theorem can also be used to compute integrals over very general sets. 


Corollary 3 Let D be a bounded set in R"~! and E = {(x, y) € R" | (x € D) A 
(gi(x) <y < g2(%))}. If f € RE), then 


92 (x) 
[ fenaray= | ax [ f(x, y) dy. (11.1) 
E D g(x) 


Proof Let Ex ={y €R| g(x) < y < m(x)} if x € Dand FE, = @ if x ¢ D. We 
remark that xz (x, y) = xp(x)- Xz, (y). Recalling the definition of the integral over 
a set and using Fubini’s theorem, we obtain 


[ feenaray= [ SxE(, y)dxdy = 
E IDE 
=f ax [ fxe(x, y)dy = 
=] (/ fi »)xe,0)ay ) x) dr = 
aes 
-|/ (/ f(s »)dy) xo) de = 
Ty \Y gi (x) 
g2(x) 
=-[(f Fess y)dy) a 
D \J g(x) 


The inner integral here may also fail to exist on a set of points in D of Lebesgue 
measure zero, and if so it is assigned the same meaning as in the theorem of Fubini 
proved above. 


Remark If the set D in the hypotheses of Corollary 3 is Jordan-measurable and the 
functions g; : D > R, i = 1, 2, are continuous and bounded, then the set E C R” is 
Jordan measurable. 
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Proof The boundary 0E of E consists of the two graphs of the continuous functions 
gi : D> R,i = 1, 2, (which by Example 2 of Sect. 11.1) are sets of measure zero) 
and the set Z, which is a portion of the product of the boundary 0D of D CR"! 
and a sufficiently large one-dimensional closed interval of length /. By hypothesis 
dD can be covered by a system of (x — 1)-dimensional intervals of total (n — 1)- 
dimensional volume less than ¢//. The direct product of these intervals and the 
given one-dimensional interval of length / gives a covering of Z by intervals whose 
total volume is less than ¢. 


Because of this remark one can say that the function f : E > 1 € R is integrable 
on a measurable set FE having this structure (as it is on any measurable set £). 
Relying on Corollary 3 and the definition of the measure of a measurable set, one 
can now derive the following corollary. 

Corollary 4 [funder the hypotheses of Corollary 3 the set D is Jordan-measurable 


and the functions gy; : D > R, i = 1,2, are continuous, then the set E is measurable 
and its volume can be computed according to the formula 


we) = | (v2) — 916) dx. (11.2) 


Example 2 For the disk E = {(x, y) € R? | x? + y* <7} we obtain by this formula 


r r 
we)= f (y[r2 = 9? = (yr =99)) dy =2 f yr —ydy= 
-r -r 
f m/2 
=4/ JP =yay=4 f rcosg d(r sing) = 
0 0 


m/2 
= arf rcos*ydg =anr’. 
0 


Corollary 5 Let E be a measurable set contained in the interval I CR". Represent 
I as the direct product I = I, x Ty of the (n — 1)-dimensional interval I, and the 
closed interval ly. Then for almost all values yo € ly the section Ey, = {(x, y) € E | 
y = yo} of the set E by the (n — 1)-dimensional hyperplane y = yo is a measurable 
subset of it, and 


wE)= | (ey)dy, (11.3) 


where 1(Ey) is the (n — 1)-dimensional measure of the set Ey if it is measurable and 
equal to any number between the numbers i 1-dx and Se, 1- dx if Ey happens to 


be anonmeasurable set. 


Proof Corollary 5 follows immediately from the theorem and Corollary 1, if we set 
Jf = Xe in both of them and take account of the relation xz (x, y) = x Ey (x). 
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Corollary 6 (Cavalieri’s® principle) Let A and B be two solids in R? having volume 
(that is, Jordan-measurable). Let Ac = {(x, y,z)€ A| z=c} and Be = {(x, y,2€ 
B | z =c} be the sections of the solids A and B by the plane z = c. If for everyc ER 
the sets Ac and B. are measurable and have the same area, then the solids A and 
B have the same volumes. 


It is clear that Cavalieri’s principle can be stated for spaces IR” of any dimension. 


Example 3 Using formula (11.3), let us compute the volume V,, of the ball B = 
{x € R” | |x| <r} of radius r in the Euclidean space R”. 


It is obvious that V; = 2. In Example 2 we found that V2 = sr’. We shall show 
that V, = cpr”, where cy, is a constant (which we shall compute below). Let us 
choose some diameter [—r,r] of the ball and for each point x € [—r, r] consider 
the section B, of the ball B by a hyperplane orthogonal to the diameter. Since B, 
is a ball of dimension n — 1, whose radius, by the Pythagorean theorem, equals 
Vr? — x, proceeding by induction and using (11.3), we can write 


r n—-1 m/2 
Vn =) Gate =a) Fes (of cos" pp) 
—r —7 [2 


(In passing to the last equality, as one can see, we made the change of variable 
x=rsing.) 
Thus we have shown that V, = cy,r”, and 


m/2 
Cn = Cn-1 i: cos” pdg. (11.4) 
—H [2 


We now find the constant c, explicitly. We remark that for m > 2 


x/2 m/2 
In = / cos” ody = 1 cos”? y(1 — sin? y) dg = 
7/2 —1/2 


1 m/2 1 


= [n-2 + —— sing dcos”—! 9 = m—2 — —— In, 
m — —n/2 m— | 


that is, the following recurrence relation holds: 


m—1 
In = ——Im-2. (11.5) 
m 


6B. Cavalieri (1598-1647) — Italian mathematician, the creator of the so-called method of indivisi- 
bles for determining areas and volumes. 
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In particular, 77 = 2/2. It is clear immediately from the definition of J, that 
I, = 2. Taking account of these values of J; and /> we find by the recurrence for- 
mula (11.5) that 


2k)! 2k — 1)! 
oni 2 Fee Gre (11.6) 


Le = Obi 


Returning to formula (11.4), we now obtain 


cont zon 2! on Qk)! @k-DY nk 
Bil eae yy Oe eC 
von econ OE op, ED R= DM 
Te oo Ceai- 
Gry 
S49 = 0)-—___—"* 
Qk! 


But, as we have seen above, cj = 2 and cz = 7, and hence the final formulas for 
the required volume V,, are as follows: 


(27)* 2k+1 V. _ Qn)k 2k 


ep a” oi) 


Vok+1 = 


where k € N, and the first of these formulas is also valid for k = 0. 


11.4.3 Problems and Exercises 


1. a) Construct a subset of the square J C R? such that on the one hand its inter- 
section with any vertical line and any horizontal line consists of at most one point, 
while on the other hand its closure equals J. 

b) Construct a function f : J > R for which both of the iterated integrals that 
occur in Fubini’s theorem exist and are equal, yet f ¢ R(/). 

c) Show by example that if the values of the function F(x) that occurs in Fu- 
bini’s theorem, which in the theorem were subjected to the conditions /(x) < 
F(x) < Z(x) at all points where 7(x) < T(x), are simply set equal to zero at 
those points, the resulting function may turn out to be nonintegrable. (Consider, 
for example, the function f(x, y) on R* equal to 1 if the point (x, y) is not ra- 
tional and to 1 — 1/q at the point (p/q,m/n), both fractions being in lowest 
terms.) 


2. a) In connection with formula (11.3), show that even if all the sections of a 
bounded set E by a family of parallel hyperplanes are measurable, the set E may 
yet be nonmeasurable. 
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b) Suppose that in addition to the hypotheses of part a) it is known that the 
function (Ey) in formula (11.3) is integrable over the closed interval J. Can we 
assert that in this case the set E is measurable? 

3. Using Fubini’s theorem and the positivity of the integral of a positive function, 
2 2. 

give a simple proof of the equality aL = af for the mixed partial derivatives, 

assuming that they are continuous functions. 


4. Let f : Ia,» — R be a continuous function defined on an interval Ig, = {x € 
R" |ai <x! <b',i=1,...,n}, and let F: Iq,p — R be defined by the equality 


F(x) = / Far, 
Tax 


where Iq. C Iq,p. Find the partial derivatives of this function with respect to the 


variables x!,...,x”. 


5. Let f(x,y) be a continuous function defined on the rectangle J = [a,b] x 
[c, d] C R?, which has a continuous partial derivative x in J. 


a) ee F(y) = ? f(x, y)dx. Starting from the equality F(y) = 
fig ( re 4 (x, t) dt+ f(x, c)) dx, verify the Leibniz rule, according to which F’(y) = 


i (x, y) dx. 
b) Let G(x, y) = f* f(t, y) dt. Find 52 and $2. 
c) Let H(y) =f" f(x, y) dx, where h € CM fa, b]. Find H’(y). 


6. Consider the sequence of integrals 


roo = | f(y) dy, Fy = [PS = a” —|— fQ)dy, neéeN, 


where f € C(R, R). 


a) Verify that F/ (x) = Fy-1(x), FA” (0) =0 if k <n, and F\"*? (x) = f(x). 
b) Show that 


x x] Xn-1 1 x 
[oan fran. [roman == fe -yy" Foray. 
0 0 0 ne JO 


7. a) Let f : E > R bea function that is continuous on the set FE = {(x, y) € IR? | 
O<x<1A0<y <x}. Prove that 


1 x 1 1 
[wf renay=f ay f roar. 
0 0 0 y 


b) Use the example of the iterated integral i dx [i casi dy to explain why not 
every iterated integral comes from a double integral via Fubini’s theorem. 
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11.5 Change of Variable in a Multiple Integral 


11.5.1 Statement of the Problem and Heuristic Derivation 
of the Change of Variable Formula 


In our earlier study of the integral in the one-dimensional case, we obtained an 
important formula for change of variable in such an integral. Our problem now is to 
find a formula for change of variables in the general case. Let us make the question 
more precise. 

Let D, be a set in R”, f a function that is integrable over D,, and gy: D, > D, 
a mapping th g(t) of aset D; C R” onto D,.. We seek a rule according to which, 
knowing f and ¢, we can find a function y in D, such that the equality 


i fxd = [ w(t) dt 
Dy D; 


holds, making it possible to reduce the computation of the integral over D, to the 
computation of an integral over D;. 

We begin by assuming that D; is an interval J C R” and gy: I > Dy, a diffeomor- 
phism of this interval onto D,.. To every partition P of the interval J into intervals 
I, In,..., I, there corresponds a partition of D, into the sets g(U/;), i =1,...,k. 
If all these sets are measurable and intersect pairwise only in sets of measure zero, 
then by the additivity of the integral we find 


k 
@)de= / (x) dx. (11.8) 
[7° 7 dX, cae ° 


If f is continuous on D,., then by the mean-value theorem 
[ Fende= Fe n(on). 
ei) 


where &; € g(/;). Since f(&) = f(p(t)), where t; = gy '(&), we need only con- 
nect (y(/j)) with wij). 

If @ were a linear transformation, then g(/;) would be a parallelepiped whose 
volume, as is known from analytic geometry, would be | det y’|jz(7;). But a diffeo- 
morphism is locally a nearly linear transformation, and so, if the dimensions of the 
intervals J; are sufficiently small, we may assume j4(y(J;)) * | det @’(z;)||1;| with 
small relative error (it can be shown that for some choice of the point t; € J; actual 
equality will result). Thus 


k k 
>, f(x)dx © D> f (g(a) |deto’()| Mil. (11.9) 
#=1° OM 


i=1 
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But, the right-hand side of this approximate equality contains a Riemann sum for 
the integral of the function f(g(t))|detg’(t)| over the interval J corresponding to 
the partition P of this interval with distinguished points tT. In the limit as A(P) > 0 
we obtain from (11.8) and (11.9) the relation 


[ sear | f (g@)|detg' (| de. 
Dy D; 


This is the desired formula together with an explanation of it. The route just 
followed in obtaining it can be traversed with complete rigor (and it is worthwhile 
to do so). However, in order to become acquainted with some new and useful general 
mathematical methods and facts and avoid purely technical work, we shall depart 
from this route slightly in the proof below. 

We now proceed to precise statements. We recall the following definition. 


Definition 1 The support of a function f : D — R defined in a domain D C R” is 
the closure in D of the set of points of x € D at which f(x) 40. 


In this section we shall study the situation when the integrand f : D, — R equals 
zero on the boundary of the domain D,, more precisely, when the support of the 
function f (denoted supp f) is a compact set’ K contained in D,. The integrals of 
f over D,. and over K, if they exist, are equal, since the function equals zero in D, 
outside of K. From the point of view of mappings the condition supp f = K C D, 
is equivalent to the statement that the change of variable x = ¢(f) is valid not only in 
the set K over which one is essentially integrating, but also in some neighborhood 
D,. of that set. 

We now state what we intend to prove. 


Theorem 1 Jf g : D; + Dy, is a diffeomorphism of a bounded open set D,; C R" 
onto a set Dy = g(D;) C R" of the same type, f € R( Dx), and supp f is a compact 
subset of Dy, then f 0 y| detg’| € R(D;), and the following formula holds: 


; fxyax= f f og(t)|dety’(1)| de. (11.10) 
Dx=9(D;) Dr 


11.5.2. Measurable Sets and Smooth Mappings 


Lemma 1 Let gy: D; > D,. be a diffeomorphism of an open set D; C R" onto a set 
D, C R" of the same type. Then the following assertions hold. 


a) If E; C D; is a set of (Lebesgue) measure zero, its image p(E;) C Dx is also 
a set of measure zero. 


7Such functions are naturally called functions of compact support in the domain. 
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b) If a set E; contained in D; along with its closure E, has Jordan measure 
zero, its image g(E;) = E, is contained in D,, along with its closure and also has 
measure zero. 

c) Ifa (Jordan) measurable set E; is contained in the domain D, along with its 
closure E,,, its image Ex = g(E;) is Jordan measurable and Ex C Dy. 


Proof We begin by remarking that every open subset D in R” can be represented 
as the union of a countable number of closed intervals (no two of which have any 
interior points in common). To do this, for example, one can partition the coordinate 
axes into closed intervals of length A and consider the corresponding partition of R” 
into cubes with sides of length A. Fixing A = 1, take the cubes of the partition 
contained in D. Denote their union by F;. Then taking A = 1/2, adjoin to F the 
cubes of the new partition that are contained in D\F. In that way we obtain a 
new set F>, and so forth. Continuing this process, we obtain a sequence F} C--- C 
F, C--+ of sets, each of which consists of a finite or countable number of intervals 
having no interior points in common, and as one can see from the construction, 
UF, =D. 

Since the union of an at most countable collection of sets of measure zero is a 
set of measure zero, it suffices to verify assertion a) for a set FE; lying in a closed 
interval J C D;. We shall now do this. 

Since g € CYC) (that is, y’ € C(J)), there exists a constant M such that 
|o’(t) || < M on I. By the finite-increment theorem the relation |x2 — x1| < M|h — 
t;| must hold for every pair of points ¢), t2 € J with images x; = g(t), x2 = p(t). 

Now let {J;} be a covering of E; by intervals such that 5°; |Ji| < ¢. Without loss 
of generality we may assume that jj = 7; NIC I. 

The collection {g(J;)} of sets g(7;) obviously forms a covering of FE, = g(E;). 
If ¢; is the center of the interval J;, then by the estimate just given for the possible 
change in distances under the mapping 9, the entire set g(/;) can be covered by the 
interval I; with center x; = —g(t;) whose linear dimensions are M times those of 
the interval J;. Since vA = M"|J;|, and g(E,) C U; I, we have obtained a covering 
of g(E;) = Ey by intervals whose total volume is less than M”¢. Assertion a) is now 
established. 

Assertion b) follows from a) if we take into account the fact that E; (and hence 
by what has been proved, E, = 9(E;) also) is a set of Lebesgue measure zero and 
that E, (and hence also E,) is a compact set. Indeed, by Lemma 3 of Sect. 11.1 
every compact set that is of Lebesgue measure zero also has Jordan measure zero. 

Finally, assertion c) is an immediate consequence of b), if we recall the definition 
of a measurable set and the fact that interior points of E; map to interior points of 
its image EF, = y(E;) under a diffeomorphism, so that dE, = g(0E;). 


Corollary Under the hypotheses of the theorem the integral on the right-hand side 
of formula (11.10) exists. 


Proof Since | dety’(t)| 40 in D,, it follows that supp(f o @ - | dety’|) = supp(f o 
v) =~ '(supp f) is a compact subset in D;. Hence the points at which the function 
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f og-|detg’|xp, in R” is discontinuous have nothing to do with the function xp,, 
but are the pre-images of points of discontinuity of f in D,. But f € R(D,), and 
therefore the set E, of points of discontinuity of f in D, is a set of Lebesgue 
measure zero. But then by assertion a) of the lemma the set FE; = g (E ) has 
measure zero. By Lebesgue’s criterion, we can now conclude that f og -|dety’|xp, 
is integrable on any interval I; D D;. 


11.5.3: The One-Dimensional Case 


Lemma 2 a) [fg : I; — 1, is a diffeomorphism of a closed interval I, C R! onto a 
closed interval I, CR! and f € R(x), then f og-|y'|€ RU) and 


/ feyde= f (fov-|o')orae (11.11) 


b) Formula (11.10) holds in R!. 


Proof Although we essentially already know assertion a) of this lemma, we shall 
use the Lebesgue criterion for the existence of an integral, which is now at our 
disposal, to give a short proof here that is independent of the proof given in Part 1. 
Since f € R(I,) and g: I; > I, is a diffeomorphism, the function f 0 g|g’| is 
bounded on /;. Only the pre-images of points of discontinuity of f on J, can be 
discontinuities of the function f o g|g’|. By Lebesgue’s criterion, the latter form a 
set of measure zero. The image of this set under the diffeomorphism yg! tl > 
as we saw in the proof of Lemma 1, has measure zero. Therefore f 0 g|g’| € R(/;). 
Now let P, be a partition of the closed interval /,. Through the mapping g7! 
it induces a partition P; of the closed interval J;, and it follows from the uniform 
continuity of the mappings g and g™! that A(P,) > 0 = A(P;) > 0. We now write 
the Riemann sums for the partitions P, and P; with distinguished points &; = g(7;): 


Y> fda — xi-il = D> f g(t) |G) - ei] = 


=> fog ale (alti — #11, 


and the points & can be assumed chosen just so that &; = g(t;), where 7; is the point 
obtained by applying the mean-value theorem to the difference g(t;) — p(tj-1). 

Since both integrals in (11.11) exist, the choice of the distinguished points in 
the Riemann sums can be made to suit our convenience without affecting the limit. 
Hence from the equalities just written for the Riemann sums, we find (11.11) for the 
integrals in the limit as A(P,) > O(A(P;) > 0). 


11.5 Change of Variable in a Multiple Integral 141 


Assertion b) of Lemma 2 follows from Eq. (11.11). We first note that in the one- 
dimensional case | det y’| = |y’|. Next, the compact set supp f can easily be covered 
by a finite system of closed intervals contained in D,, no two of which have common 
interior points. The integral of f over D, then reduces to the sum of the integrals 
of f over the intervals of this system, and the integral of f o g|g’| over D; reduces 
to the sum of the integrals over the intervals that are the pre-images of the intervals 
in this system. Applying Eq. (11.11) to each pair of intervals that correspond under 
the mapping ¢ and then adding, we obtain (11.10). 


Remark 1 The formula for change of variable that we proved previously had the 
form 


o(B) B j 
J. f(x) dx =f ((fog)-g')@)dt, (11.12) 
pa) a 

where ¢ was any smooth mapping of the closed interval [a, 6] onto the interval with 
endpoints y(a) and g(8). Formula (11.12) contains the derivative g’ itself rather 
than its absolute value |y’|. The reason is that on the left-hand side it is possible that 
p(B) < pa). 


However, if we observe that the relations 


1 —f? f(x)dx, ifa>d, 


hold, it becomes clear that when ¢ is a diffeomorphism formulas (11.11) and (11.12) 
differ only in appearance; in essence they are the same. 


Remark 2 It is interesting to note (and we shall certainly make use of this observa- 
tion) that if g : I; > J, is a diffeomorphism of closed intervals, then the formulas 


[ serar= [ (Fovlenar 


[roa = [(rovle'oar, 


Ty I 


for the upper and lower integrals of real-valued functions are always valid. 

Given that fact, we may take as established that in the one-dimensional case 
formula (11.10) remains valid for any bounded function f if the integrals in it are 
understood as upper or lower Darboux integrals. 


Proof We shall assume temporarily that f is a nonnegative function bounded by a 
constant M. 

Again, as in the proof of assertion a) of Lemma 2, one may take partitions P, 
and P; of the intervals 7, and J; respectively that correspond to each other under the 
mapping ¢ and write the following estimates, in which ¢ is the maximum oscillation 


— 
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of g on intervals of the partition P;: 


>> sup f(@)lai — mi-11 < 


7 XE AX; 


<)> sup f(g@)) sup |g"()|It — 1-11 < 
i te At; te At; 
: Ati| < 
= Yi sp (s( v(0)) sup |o'(|) ti 
a sup ( f(g@))(|e’O] + e)1Atil < 


< dX, sup ( f (9) |¢' |) I Atl us sup f(9@®)|4il < 


tj 


pe sup (f(g) |g @)|)|Atil + eM |Z. 


7 te At; 


Taking account of the uniform continuity of g we obtain from this the relation 


[ teres [ (Fovle oar 


as 4(P;) > 0. Applying what has just been proved to the mapping y~! and the 
function f o y|g’|, we obtain the opposite inequality, and thereby establish the first 
equality in Remark 2 for a nonnegative function. But since any function can be 
written as f = max{ f, 0} — max{— /f, 0} (a difference of two nonnegative functions) 
the equality can be considered to be established in general. The second equality is 
verified similarly. 


From the equalities just proved one can of course obtain once again assertion a) 
of Lemma 2 for real-valued functions f. 


n 


A 


11.5.4 The Case of an Elementary Diffeomorphism in 


Let y: D; > Dy, be a diffeomorphism of a domain D; C R/ onto a domain D, C 
IR¢ with (t!,...,¢”) and (x!,...,«”) the coordinates of points t € IR? and x € R¢ 
respectively. We recall the following definition. 


Definition 2 The diffeomorphism g : D; > D,, is elementary if its coordinate rep- 
resentation has the form 
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xk! =¢ (C7... %)=" 1, 

x = gk (el, Harr, Jt, as 
xktl = g*(t!, ; t") _ perl 

x” = g"(z!, ler 


Thus only one coordinate is changed under an elementary diffeomorphism (the 
kth coordinate in this case). 


Lemma 3 Formula (11.10) holds for an elementary diffeomorphism. 


Proof Up to a relabeling of coordinates we may assume that we are considering a 
diffeomorphism ¢ that changes only the nth coordinate. For convenience we intro- 
duce the following notation: 


a veage ) = (40°); (t', Sess eS. (t0"); 
Dyn (Xo) = {(%, x") € Dy | ¥ = Xo}; 
Dy, (to) = {(@t") € D; [f=% . 

Thus Dy» (X) and D;»(f) are simply the one-dimensional sections of the sets D, 
and D, respectively by lines parallel to the nth coordinate axis. Let J, be an inter- 
val in R* containing D,. We represent J, as the direct product I, = Iz x I, of 
an (n — 1)-dimensional interval Jz and a closed interval J,» of the nth coordinate 
axis. We give a similar representation J, = I; x I; for a fixed interval J; in R? 
containing D;. 


Using the definition of the integral over a set, Fubini’s theorem, and Remark 2, 
we can write 


/ fear = f f-xp,c)ax= [ dx ff - xp, (%, x") dx” = 
Dy I, ik In 
-/ av | Jeo") de = 
i Dyn (X) 


ks, 2 _ ag” 
= | dt t,o" (t,t” 
iE Loot! on | at” 
[a (fF og|deto’|xn,) (Ft) de” = 
IP I,n 


(7,t”) dt? = 


= (Fovldcte’xo,)nar= f (f o g|detg’|) (1) dr. 


I; D; 
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ag” 


a9R for the diffeomor- 


In this computation we have used the fact that dety’ = 
phism under consideration. 


11.5.5 Composite Mappings and the Formula for Change 
of Variable 


Lemma 4 /f D, x D; a Dy, are two diffeomorphisms for each of which formula 
(11.10) for change of variable in the integral holds, then it holds also for the com- 
position poy: Dy > Dy, of these mappings. 


Proof It suffices to recall that (g o wy)’ = gy’ o W’ and that det(y o w)/(t) = 
det yg’ (t) det w’(t), where t = y(t). We then have 


i: pyar = | (f 0 g|detg’ 
Dy D; 


=| ((fogow)|dety’ o y||det’|)(t) dt = 


dt = 


nS” 


= [ (Fewow|deyow)ierar, 


11.5.6 Additivity of the Integral and Completion of the Proof 
of the Formula for Change of Variable in an Integral 


Lemmas 3 and 4 suggest that we might use the local decomposition of any diffeo- 
morphism as a composition of elementary diffeomorphisms (see Proposition 2 from 
Sect. 8.6.4 of Part 1) and thereby obtain the formula (11.10) in the general case. 

There are various ways of reducing the integral over a set to integrals over small 
neighborhoods of its points. For example, one may use the additivity of the integral. 
That is the procedure we shall use. On the basis of Lemmas 1, 3, and 4 we now carry 
out the proof of Theorem | on change of variable in a multiple integral. 


Proof For each point t of the compact set K; = supp((f 0 g)| det @’|) C D; we con- 
struct a 6(t)-neighborhood U (t) of it in which the diffeomorphism g decomposes 
into a composition of elementary diffeomorphisms. From the ee neighborhoods 
U(t) Cc U(t) of the points t € K; we choose a finite covering U(t)),..., U (te) of 
the compact set K;. Let 6 = 5 min{4(t1), ...,O(tg)}. Then the closure of any set 
whose diameter is smaller than 6 and which intersects K; must be contained in at 
least one of the neighborhoods U(t), vied OU (tk). 

Now let J be an interval containing the set D; and P a partition of the interval 
I such that A(P) < min{6, d}, where 6 was found above and d is the distance from 
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K, to the boundary of D;. Let Z := {J;} be the intervals of the partition P that have 
a nonempty intersection with K;. It is clear that if J; € Z, then J; C D; and 


[ (reolacte'nar= [ (Fe elaete'|)x0,) a = 


=> | (reolacte’ iar (11.13) 


By Lemma | the image E; = g(/;) of the intervals J; is a measurable set. Then 
the set E =); £; is also measurable and supp f C E = E C Dy. Using the addi- 
tivity of the integral, we deduce from this that 


/ fear = [ fro. )ax= f fav, cax+ f f Xp, (x) dx = 
Dy eDDx L\E E 


=) fxo.x)ax= f fear => | f(x) dx. (11.14) 
E E 7, Ej 


By construction every interval J; € Z is contained in some neighborhood U (x;) 
inside which the diffeomorphism g decomposes into a composition of elementary 
diffeomorphisms. Hence on the basis of Lemmas 3 and 4 we can write 


i fisyar= f (foglaete!|)in ar (11.15) 


Comparing relations (11.13), (11.14), and (11.15), we obtain formula (11.10). 


11.5.7 Corollaries and Generalizations of the Formula for Change 
of Variable in a Multiple Integral 


a. Change of Variable Under Mappings of Measurable Sets 


Proposition 1 Let g: D, > D, be a diffeomorphism of a bounded open set Dy C 
R” onto a set D, C R" of the same type; let E, and E, be subsets of D, and Dx 
respectively and such that E; C D,, Ex C Dy, and Ey = G(E,). If f € R(Ex), then 
f cg|dety’| € R(E,), and the following equality holds: 


[ revar= ff (Fooldero"iorar (11.16) 
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Proof Indeed, 
i fie i; (pastie= : (((Fxz,) 09) |deto'|) dt = 
Ex Dx Dr 


=| (Fowace'|xe)inar= fi ((fepr|dere!|)inar. 


In this computation we have used the definition of the integral over a set, formula 
(11.10), and the fact that xz, = Xz, O@. 


b. Invariance of the Integral 


We recall that the integral of a function f : E > R over a set E reduces to comput- 
ing the integral of the function fx over an interval J > E. But the interval / itself 
was by definition connected with a Cartesian coordinate system in IR”. We can now 
prove that all Cartesian systems lead to the same integral. 


Proposition 2 The value of the integral of a function f over a set E C R" is inde- 
pendent of the choice of Cartesian coordinate system in R". 


Proof In fact the transition from one Cartesian coordinate system in R” to another 
Cartesian system has a Jacobian constantly equal to 1 in absolute value. By Propo- 
sition | this implies the equality 


/ fa)dx= / (f 0 py(a)dt. 
Ex E; 


But this means that the integral is invariantly defined: if p is a point of EF having 
coordinates x = (x!,...,x”) in the first system and t = (t!,...,¢”) in the second, 
and x = g(t) is the transition function from one system to the other, then 


DATA ci SHE secs"), 


where f; = f; og. Hence we have shown that 


[ roars fr@ dt, 
Ex E; 


where EF, and E; denote the set F in the x and ¢ coordinates respectively. 


We can conclude from Proposition 2 and Definition 3 of Sect. 11.2 for the (Jor- 
dan) measure of a set E C R” that this measure is independent of the Cartesian 
coordinate system in R”, or, what is the same, that Jordan measure is invariant un- 
der the group of rigid Euclidean motions in R”. 
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c. Negligible Sets 


The changes of variable or formulas for transforming coordinates used in practice 
sometimes have various singularities (for example, one-to-oneness may fail in some 
places, or the Jacobian may vanish, or differentiability may fail). As a rule, these 
singularities occur on a set of measure zero and so, to meet the demands of practice, 
the following theorem is very useful. 


Theorem 2 Let g: D; — D, be a mapping of a (Jordan) measurable set D; CR} 
onto a set Dy C R¢ of the same type. Suppose that there are subsets S; and Sx 
of D; and Dx respectively having (Lebesgue) measure zero and such that D;\S; 
and D,\S, are open sets and ~ maps the former diffeomorphically onto the latter 
and with a bounded Jacobian. Then for any function f € R(D,) the function (f o 
y)| det g’| also belongs to R(D;\S;) and 


/ f (x) dx =f ((f 0 )|det g’|)(t) dr. (11.17) 
Dy DiS; 
If, in addition, the quantity | det y'| is defined and bounded in D,, then 

iL f (x) dx =f ((f 0 )|det¢’|) (2) de. (11.18) 


Proof By Lebesgue’s criterion the function f can have discontinuities in D, and 
hence also in D,\S, only on a set of measure zero. By Lemma |, the image of this 
set of discontinuities under the mapping g~! : D,\S, — D,\S; is a set of measure 
zero in D;\S;. Thus the relation (f 0 g)| detg’| € R(D;\S;) will follow immedi- 
ately from Lebesgue’s criterion for integrability if we establish that the set D;\ S; is 
measurable. The fact that this is indeed a Jordan measurable set will be a by-product 
of the reasoning below. 

By hypothesis D,.\S; is an open set, so that (D,\S;) 1 0S, = @. Hence 0S; C 
dD, U Sy and consequently 0D, U S, = dD, U S,, where S; = S; US, is the 
closure of S, in R{. As a result, 0D, U S; is a closed bounded set, that is, it is com- 
pact in R”, and, being the union of two sets of measure zero, is itself of Lebesgue 
measure zero. From Lemma 3 of Sect. 11.1 we know that then the set 0D, U Sy 
(and along with it, S,) has measure zero, that is, for every ¢ > 0 there exists a finite 
covering [),..., J; of this set by intervals such that 2a 1 il < €. Hence it follows, 
in particular, that the set D,.\S, (and similarly the set D;\S;) is Jordan measurable: 
indeed, 0(D,x\Sx) C OD, UdS, C AD, U Sx. 

The covering [;,..., 7, can obviously also be chosen so that every point x € 
dD,\S, is an interior point of at least one of the intervals of the covering. Let 
U, = Ui , Ji. The set U, is measurable, as is V, = D,\U,. By construction the set 
V, is such that V, Cc D,.\S, and for every measurable set FE, C D, containing the 


148 


— 


1 Multiple Integrals 
compact set V, we have the estimate 


i fsydx— f f(x) dx 
Dy Ex 


= 


= / f(x) dx 
Dx\Ex 


< Mu(D,\Ex) < M-e, (11.19) 


where M = supyep, f(x). 

The pre-image V; = g!(Vx) of the compact set V; is a compact subset of 
D;\S;. Reasoning as above, we can construct a measurable compact set W; subject 
to the conditions V; C W; C D,\S; and having the property that the estimate 


if ((fo9)|dere'\)inar — f ((f 0 )|dety’|)(t) dt} <e (11.20) 
DAS; E, 


holds for every measurable set E, such that W, C E; C D;\S;. 

Now let E, = g(£;). Formula (11.16) holds for the sets FE, C D,\S, and E; Cc 
D;\S; by Lemma 1. Comparing relations (11.16), (11.19), and (11.20) and taking 
account of the arbitrariness of the quantity e > 0, we obtain (11.17). 

We now prove the last assertion of Theorem 2. If the function (f o @)|detg’| 
is defined on the entire set D,, then, since D,\S; is open in R’, the entire set of 
discontinuities of this function in D; consists of the set A of points of discontinuity 
of (f og)| det g'||p,\5, (the restriction of the original function to D;,\S;) and perhaps 
a subset B of S, U0D,. 

As we have seen, the set A is a set of Lebesgue measure zero (since the integral 
on the right-hand side of (11.17) exists), and since S; U 0D; has measure zero, the 
same can be said of B. Hence it suffices to know that the function (f o y)| det gy’ | is 
bounded on D;; it will then follow from the Lebesgue criterion that it is integrable 
over D;. But | f o g|(t) < M on Dy, so that the function (f o g)| det y’| is bounded 
on S;, given that the function | det y’| is bounded on S; by hypothesis. As for the set 
D,\S;, the function (f og)| det y’| is integrable over it and hence bounded. Thus, the 
function (f 0 )| det ¢’| is integrable over D;. But the sets D, and D,\S; differ only 
by the measurable set S;, whose measure, as has been shown, is zero. Therefore, 
by the additivity of the integral and the fact that the integral over S; is zero, we can 
conclude that the right-hand sides of (11.17) and (11.18) are indeed equal in this 
case. 


Example The mapping of the rectangle J = {(r, g) € R? |0<r< RAO <9 <2z} 
onto the disk K = {(x, y) € R* | x? + y? < R?} given by the formulas 


xX =Prcosg, y=rsing, (11.21) 


is not a diffeomorphism: the entire side of the rectangle J on which r = 0 maps to 
the single point (0, 0) under this mapping; the images of the points (r, 0) and (r, 277) 
are the same. However, if we consider, for example, the sets 7\d/7 and K\E, where 
E is the union of the boundary 0K of the disk K and the radius ending at (0, R), 
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then the restriction of the mapping (11.21) to the domain /\d/ turns out to be a 
diffeomorphism of it onto the domain K\E. Hence by Theorem 2, for any function 
f €R(K) we can write 


II fee. dvdy= ff forcose.rsingyr ar dg 
K I 


and, applying Fubini’s theorem 


20 R 
II fle. ydrdy = f ay | f(rcosg,rsing)r dr. 
K 0 0 


Relations (11.21) are the well-known formulas for transition from polar coordi- 
nates to Cartesian coordinates in the plane. 

What has been said can naturally be developed and extended to the polar (spheri- 
cal) coordinates in IR” that we studied in Part 1, where we also exhibited the Jacobian 
of the transition from polar coordinates to Cartesian coordinates in a space R” of 
any dimension. 


11.5.8 Problems and Exercises 


1. a) Show that Lemma | is valid for any smooth mapping g : D; > Dy, (also see 
Problem 8 below in this connection). 

b) Prove that if D is an open set in R” and gy € C“!)(D, R”), then g(D) is a set 
of measure zero in R” when m <n. 


2. a) Verify that the measure of a measurable set E and the measure of its image 
y(E) under a diffeomorphism ¢g are connected by the relation w(g(E)) = 0u(E), 
where 6 € [inf,<x | det gy’ (t)|, sup,<, | det gy’ (t)|]. 

b) In particular, if E is a connected set, there is a point t € E such that 
L(g(E)) = | det g’(t)| ME). 


3. a) Show that if formula (11.10) holds for the function f = 1, then it holds in 
general. 

b) Carry out the proof of Theorem | again, but for the special case f = 1, sim- 
plifying it for this special situation. 


4. Without using Remark 2, carry out the proof of Lemma 3, assuming Lemma 2 
is known and that two integrable functions that differ only on a set of measure zero 
have the same integral. 

5. Instead of the additivity of the integral and the accompanying analysis of the 
measurability of sets, one can use another device for localization when reducing 
formula (11.10) to its local version (that is to the verification of the formula for a 
small neighborhood of the points of the domain being mapped). This device is based 
on the linearity of the integral. 
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a) If the smooth functions e;,..., e, are such thatO <e; <1,i=1,...,k, and 
x e;(x) = 1 on D,, then Sp, oan e; f)(x) dx = tp, f(x) dx for every function 
fe R(Dx). 

b) If suppe; is contained in the set U C D,, then Sp, (e; f(x) dx = 
Sy (i f(a) (dx). 

c) Taking account of Lemmas 3 and 4 and the linearity of the integral, one can 
derive formula (11.10) from a) and b), if for every open covering {U,} of the com- 
pact set K = supp f C D, we construct a set of smooth functions e,...,e% in 
D, such thatO <e <1,i=1,...,k, ee e; = 1 on K, and for every function 
e; € {e;} there is a set Ug, € {Uq} such that supp e; C Us;. 


In that case the set of functions {e;} is said to be a partition of unity on the compact 
set K subordinate to the covering {Uy}. 
6. This problem contains a scheme for constructing the partition of unity discussed 
in Problem 5. 


a) Construct a function f € C©)(R,R) such that f|;—1,1; =1 and supp f Cc 
[—1—6,1-+ 6], where 6 > 0. 

b) Construct a function f €¢ C‘°)(R”, R) with the properties indicated in a) for 
the unit cube in R” and its 5-dilation. 

c) Show that for every open covering of the compact set K C R” there exists a 
smooth partition of unity on K subordinate to this covering. 

d) Extending c), construct a C‘©)-partition of unity in R” subordinate to a lo- 
cally finite open covering of the entire space. (A covering is locally finite if every 
point of the set that is covered, in this case R”, has a neighborhood that intersects 
only a finite number of the sets in the covering. For a partition of unity containing 
an infinite number of functions {e;} we impose the requirement that every point 
of the set on which this partition is constructed belongs to the support of at most 
finitely many of the functions {e;}. Under this hypothesis no questions arise as to 
the meaning of the equality }”; e; = 1; more precisely, there are no questions as to 
the meaning of the sum on the left-hand side.) 


7. One can obtain a proof of Theorem | that is slightly different from the one given 
above and relies on the possibility of decomposing only a linear mapping into a 
composition of elementary mappings. Such a proof is closer to the heuristic consid- 
erations in Sect. 11.5.1 and is obtained by proving the following assertions. 


a) Verify that under elementary linear mappings L : R” — R” of the form 
a’, a ak, ee) e (a ee ane © ade ae engie )y 


A 0, and 


ee ere e Guana (a ee eae") 
the relation 4(L(E)) = | det L'|\4(E) holds for every measurable set E Cc R”; then 
show that this relation holds for every linear transformation L : R”? > R”. (Use 
Fubini’s theorem and the possibility of decomposing a linear mapping into a com- 
position of the elementary mappings just exhibited.) 
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b) Show that if g : D, ~ D, is a diffeomorphism, then w(g(K)) < 
f x | det gy’ (t)| dt for every measurable compact set K C D;, and its image g(K). (If 
a € D,, then 4(y'(a))~! and in the representation y(t) = (y'(a) 0 (y'(a))~! 0 g(t) 
the mapping g’(a) is linear while the transformation (g’ (a))~! 0 gy is nearly an 
isometry on a neighborhood of a.) 

c) Show that if the function f in Theorem | is nonnegative, then {, Dy f(x) dx < 
Ip, Cf ogi dety'|)(a) dt. 

d) Applying the preceding inequality to the function (f 0 g)| det y’ and the map- 
ping g~!: D, — D,, show that formula (11.10) holds for a nonnegative function. 

e) By representing the function f in Theorem | as the difference of integrable 
nonnegative functions, prove that formula (11.10) holds. 


8. Sard’s lemma. Let D be an open set in R", let p € CD, R"), and let S be the 
set of critical points of the mapping y. Then (S) is a set of (Lebesgue) measure 
zero. 

We recall that a critical point of a smooth mapping y of a domain D C R” into 
R” is a point x € D at which rankg’(x) < min{m, n}. In the case m =n, this is 
equivalent to the condition det y’(x) = 0. 


a) Verify Sard’s lemma for a linear transformation. 

b) Let J be an interval in the domain D and g € C“!)(D, R”). Show that there 
exists a function a(h), a: R” — R such that a(h) > 0 as h > 0 and |g(x +h) — 
(x) — g'(x)h| < a(h)|h| for every x,x +hel. 

c) Using b), estimate the deviation of the image g(/) of the interval J under the 
mapping ¢ from the same image under the linear mapping L(x) = g(a)+ @'(a)(x — 
a), whereae I. 

d) Based on a), b), and c), show that if S is the set of critical points of the 
mapping ¢ in the interval J, then g(S) is a set of measure zero. 

e) Now finish the proof of Sard’s lemma. 

f) Using Sard’s lemma, show that in Theorem | it suffices to require that the 
mapping 9 be a one-to-one mapping of class C‘) (D,, Dx). 


We remark that the version of Sard’s lemma given here is a simple special case of 
a theorem of Sard and Morse, according to which the assertion of the lemma holds 
even if D C R” and g € C“ (D, R"), where k = max{m —n+1, 1}. The quantity k 
here, as an example of Whitney shows, cannot be decreased for any pair of numbers 
m and n. 

In geometry Sard’s lemma is known as the assertion that if g¢ : D — R” is 
a smooth mapping of an open set D C R” into R”, then for almost all points 
x € g(D), the complete pre-image er te) = M, in D is a surface (manifold) of 
codimension n in R” (that is, m — dim M, =7n for almost all x € D). 
9. Suppose we consider an arbitrary mapping g € C\(D;,,D,) such that 
dety'(t) £0 in D; instead of the diffeomorphism y of Theorem 1. Let n(x) = 
card{t € supp(f o ¢) | g(t) = x}, that is, n(x) is the number of points of the sup- 
port of the function f o @ that map to the point x € D, under g : D; > D,. The 
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following formula holds: 
[ gemear=f (Foplaee' oar 
Dy Dt 


a) What is the geometric meaning of this formula for f = 1? 

b) Prove this formula for the special mapping of the annulus D; = {tf € R? | 
1 < |t| < 2} onto the annulus D, = {x € R2 | 1 < |x| < 2} given in polar coordi- 
nates (r, g) and (p, @) in the planes R2 and R? respectively by the formulas r = p, 
g=20. 

c) Now try to prove the formula in general. 


11.6 Improper Multiple Integrals 
11.6.1 Basic Definitions 


Definition 1 An exhaustion of a set E C R” is a sequence of measurable sets {E;,} 
such that E, C En41 C E for anyne Nand U™, E, =E. 


Lemma /f {E,,} is an exhaustion of a measurable set E, then: 


a) limn—oo M(En) = M(E); 
b) for every function f € R(E) the function f\p, also belongs to R(En), and 


tim, [ feydx= fi fear. 
noo En E 


Proof Since Ey, C Ens, C E, it follows that w(E,) < w(En41) < wCE) and 
lim, +o U(E,) < uw(E). To prove a) we shall show that the inequality 
limyn—oo UL (En) > U(E) also holds. 

The boundary 0£ of E has content zero, and hence can be covered by a finite 
number of open intervals of total content less than any preassigned number ¢ > 0. 
Let A be the union of all these open intervals. Then the set E UA = : E is open in 
R” and by construction E contains the closure of E and WE) < < wW(E)+ w(A) < 
W(E) +6. 

For every set E, of the exhaustion {E,,} the construction just described can 
be repeated with the value ¢, = ¢/2”. We then obtain a sequence of open sets 
je = E, U Ay such that Ey, C Ex W(En ) < wW(En) + W(An) < W(En) + &n, and 
RG esp opm oa ene oe 


The system of open sets A, E}, E>,..., forms an open covering of the compact 
set E. aie tel me - 
Let A, FE), Eo,..., Ex be a finite covering of E extracted from this covering. 


Since E; C E27 C--- C Ex, the sets A, Aj,..., Ax, Ex also form a covering of E 
and hence 


W(E) < wW(E) < w(Ex) + w(A) + (Al) +++ + (AR) < (Ex) + 2e. 
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It follows from this that w(E) < limp. U(E;). 

b) The relation f|z € R(E,,) is well known to us and follows from Lebesgue’s 
criterion for the existence of the integral over a measurable set. By hypothesis f € 
R(E), and so there exists a constant M such that | f(x)| < M on E. From the 
additivity of the integral and the general estimate for the integral we obtain 


i flaydx — | f(x) dx 
E En 


From this, together with what was proved in a), we conclude that b) does indeed 
hold. 


f(x) dx 


E\En 


< Mu(E\En). 


Definition 2 Let {£,,} be an exhaustion of the set E and suppose the function f : 
E — Ris integrable on the sets E, € {Ey}. If the limit 


[ tea= tim, [ f(x) dx 
E n> JE, 


exists and has a value independent of the choice of the sets in the exhaustion of F, 
this limit is called the improper integral of f over E. 


The integral sign on the left in this last equality is usually written for any function 
defined on E, but we say that the integral exists or converges if the limit in Defini- 
tion 2 exists. If there is no common limit for all exhaustions of FE, we say that the 
integral of f over E does not exist, or that the integral diverges. 

The purpose of Definition 2 is to extend the concept of integral to the case of an 
unbounded integrand or an unbounded domain of integration. 

The symbol introduced to denote an improper integral is the same as the symbol 
for an ordinary integral, and that fact makes the following remark necessary. 


Remark 1 If E is a measurable set and f € R(£), then the integral of f over E in 
the sense of Definition 2 exists and has the same value as the proper integral of f 
over E. 


Proof This is precisely the content of assertion b) in the lemma above. 


The set of all exhaustions of any reasonably rich set is immense, and we do not 
use all exhaustions. The verification that an improper integral converges is often 
simplified by the following proposition. 


Proposition 1 [fa function f: E — R is nonnegative and the limit in Definition 2 
exists for even one exhaustion {E,} of the set E, then the improper integral of f 
over E converges. 


Proof Let {E;,} be a second exhaustion of E into elements on which /f is integrable. 
The sets Ek = E,N En, n=1,2,... form an exhaustion of the set E;, and so it 
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follows from part b) of the lemma that 


i f(x)dx = tim, | f(x)dx < tim, [ f(x)dx =A. 
Et n—->Co Ek n—>oo Ey 


Since f > 0 and E;, Cc Ey. C E, it follows that 


5 tim, f f@)dx=B<A. 
k+>oo EX 


But there is symmetry between the exhaustions {E,,} and LE; }, so that A < B also, 
and hence A = B. 


Example I Let us find the improper integral f'/»2 en +) dx dy. 


We shall exhaust the plane R* by the sequence of disks E, = {(x, y) € R? | 
x* + y* <n?}. After passing to polar coordinates we find easily that 


ee 20 n 2 3 
II ee aray =f ay | e"dr=x(l-e")>ox 
En 0 0 


as in —> OO. 
By Proposition | we can now conclude that this integral converges and equals z. 
One can derive a useful corollary from this result if we now consider the exhaus- 
tion of the plane by the squares E/ = {(x, y) € R? | |x| <n A |y| <n}. By Fubini’s 


theorem 
ad n n 2.2 n 2 2 
II eo +y 'drdy= | ay [ eo & +y Jdx = (/ e! tr) a 
E —n —n aot 


By Proposition | this last quantity must tend to 2 as n — oo. Thus, following 
Euler and Poisson, we find that 


, 
n 


+00, 
i e* dx=Jnz. 


—oo 


Some additional properties of Definition 2 of an improper integral, which are not 
completely obvious at first glance, will be given below in Remark 3. 


11.6.2 The Comparison Test for Convergence of an Improper 
Integral 


Proposition 2 Let f and g be functions defined on the set E and integrable over 
exactly the same measurable subsets of it, and suppose |f(x)| < g(x) on E. If 
the improper integral te g(x) dx converges, then the integrals te | f\(x) dx and 
i g J (x) dx also converge. 
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Proof Let {E,,} be an exhaustion of E on whose elements both g and f are inte- 
grable. It follows from the Lebesgue criterion that the function | f| is integrable on 
the sets E,, n € N, and so we can write 


[. fleoax ff iricnar= | fle dx < 
En+k En En+k\En 


=| eax = [ sydx— f g(xyde, 
En+k\En En+k En 


where k and n are any natural numbers. When we take account of Proposition | and 
the Cauchy criterion for the existence of a limit of a sequence, we conclude that the 
integral [ lf |G) dx converges. 

Now consider the functions fy := (| f|+ f) and f_ := 3(\f|— f). Obviously 
O< f, <|f| and 0 < f- <|f|. By what has just been proved, the improper inte- 
grals of f, and f_ over E both converge. But f = f,— f_, and hence the improper 
integral of f over the same set converges as well (and is equal to the difference of 
the integrals of f, and f_). 


In order to make effective use of Proposition 2 in studying the convergence of 
improper integrals, it is useful to have a store of standard functions for comparison. 
In this connection we consider the following example. 


Example 2 In the deleted n-dimensional ball of radius 1, B C R” with its center 
at 0 removed, consider the function 1/r%, where r = d(0, x) is the distance from 
the point x € B\0 to the point 0. Let us determine the values of a € R for which 
the integral of r~* over the domain B\0 converges. To do this we construct an 
exhaustion of the domain by the annular regions B(e) = {x € B| e <d(0,x) < 1}. 
Passing to polar coordinates with center at 0, by Fubini’s theorem, we obtain 


dx _ d 5 a * a 1dr 
Bie) r@(x) Oe is € re me € pa 


where dg = dg, ...dg,_; and f(g) is a certain product of sines of the angles 
Y1,--+, Pn—2 that appears in the Jacobian of the transition to polar coordinates in R”, 
while c is the magnitude of the integral over s, which depends only on n, not on r 
and e. 

As € — +0 the value just obtained for the integral over B(e) will have a finite 
limit if @ <n. In all other cases this last integral tends to infinity as e > +0. 

Thus we have shown that the function qa ir xy? where d is the distance to the 
point 0, can be integrated in a deleted neighborhood of 0 only when a <n, where n 
is the dimension of the space. 

Similarly one can show that outside the ball B, that is, in a neighborhood of 
infinity, this same function is integrable in the improper sense only for a > n. 


Example 3 Let I = {x € RR" |0< x! <1,i=1,...,n} be the n-dimensional cube 
and J; the k-dimensional face of it defined by the conditions x*+! =... =x" =0. 
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On the set /\J; we consider the function aoe where d(x) is the distance from 
x € I\I; to the face J;. Let us determine the values of a € R for which the integral 
of this function over /\ J; converges. 

We remark that if x = (x!,...,x%, x44!) ..., x”) then 


d(x) = V(x)? poet (xr), 


Let I(¢) be the cube J from which the e-neighborhood of the face J, has been 
removed. By Fubini’s theorem 


dx i , dass” du 
= dx’ ...dx aeRO nal = —, 
(ey) A(x) I, Type) (XRT)? + + + (et)? I,_4(e) |U|® 


where u = (xt! ... x”) and I,_x(e) is the face I,_~% C R"-* from which the e- 
neighborhood of 0 has been removed. 

But it is clear on the basis of the experience acquired in Example | that the last 
integral converges only for ~ <n — k. Hence the improper integral under consider- 
ation converges only for a < n — k, where k is the dimension of the face near which 
the function may increase without bound. 


Remark 2 In the proof of Proposition 2 we verified that the convergence of the in- 
tegral | f| implies the convergence of the integral of f. It turns out that the con- 
verse is also true for an improper integral in the sense of Definition 2, which was 
not the case previously when we studied improper integrals on the line. In the 
latter case, we distinguished absolute and nonabsolute (conditional) convergence 
of an improper integral. To understand right away the essence of the new phe- 
nomenon that has arisen in connection with Definition 2, consider the following 
example. 


Example 4 Let the function f : Ry — R be defined on the set R+ of nonnegative 


(-1y"7! 


numbers by the following conditions: f(x) = —>—, ifn -—1<x<n,neN. 


Since the series )°°° | a converges, the integral i J (x) dx has a limit as 
A — oo equal to the sum of this series. 

However, this series does not converge absolutely, and one can make it divergent 
to +00, for example, by rearranging its terms. The partial sums of the new series 
can be interpreted as the integrals of the function f over the union E,, of the closed 
intervals on the real line corresponding to the terms of the series. The sets E,,, taken 
all together, however, form an exhaustion of the domain Ry on which f is defined. 

Thus the improper integral in Ff (x) dx of the function f : RR, — R exists in its 
earlier sense, but not in the sense of Definition 2. 

We see that the condition in Definition 2 that the limit be independent of the 
choice of the exhaustion is equivalent to the independence of the sum of a series 
on the order of summation. The latter, as we know, is exactly equivalent to absolute 
convergence. 
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In practice one nearly always has to consider only special exhaustions of the fol- 
lowing type. Let a function f : D — R defined in the domain D be unbounded in 
a neighborhood of some set E C 0D. We then remove from D the points lying in 
the e-neighborhood of E and obtain a domain D(¢) Cc D. As ¢ > 0 these domains 
generate an exhaustion of D. If the domain is unbounded, we can obtain an exhaus- 
tion of it by taking the D-complements of neighborhoods of infinity. These are the 
special exhaustions we mentioned earlier and studied in the one-dimensional case, 
and it is these special exhaustions that lead directly to the generalization of the no- 
tion of Cauchy principal value of an improper integral to the case of a space of any 
dimension, which we discussed earlier when studying improper integrals on the line. 


11.6.3 Change of Variable in an Improper Integral 


In conclusion we obtain the formula for change of variable in improper integrals, 
thereby making a valuable, although very simple, supplement to Theorems | and 2 
of Sect. 11.5. 


Theorem 1 Let ¢ : D; > Dy be a diffeomorphism of the open set D; C Ry onto the 
set Dy C R® of the same type, and let f : Dy — R be integrable on all measurable 
compact subsets of D,. If the improper integral [ Dy f (x) dx converges, then the 


integral So, ((f o@)|det@’|)(t) dt also converges and has the same value. 


Proof The open set D; C R? can be exhausted by a sequence of compact sets E*, 
k € N, contained in N, each of which is the union of a finite number of intervals 
in R? (in this connection, see the beginning of the proof of Lemma 1 in Sect. 11.5). 
Since g: D; > Dy, is a diffeomorphism, the exhaustion Ek of D,, where Ee = 
g(E*), corresponds to the exhaustion {E*} of D;. Here the sets E* — g(E*) are 
measurable compact sets in D, (measurability follows from Lemma | of Sect. 11.5). 
By Proposition | of Sect. 11.5 we can write 


d fsyde=f (fo p)|dere! iar, 


The left-hand side of this equality has a limit by hypothesis as k + oo. Hence 
the right-hand side also has the same limit. 


Remark 3 By the reasoning just given we have verified that the integral on the right- 
hand side of the last equality has the same limit for any exhaustion D, of the given 
special type. It is this proven part of the theorem that we shall be using. But for- 
mally, to complete the proof of the theorem in accordance with Definition 2 it is 
necessary to verify that this limit exists for every exhaustion of the domain D;. We 
leave this (not entirely elementary) proof to the reader as an excellent exercise. We 
remark only that one can already deduce the convergence of the improper integral 
of | f o || detgy’| over the set D; (see Problem 7). 
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Theorem 2 Let gy : D; > D, be a mapping of the open sets D; and D,,. Assume 
that there are subsets S; and S, of measure zero contained in D,; and D,. respec- 
tively such that D;\S; and D,\S x are open sets and ¢ is a diffeomorphism of the 
former onto the latter. Under these hypotheses, if the improper integral | Dy f(x) dx 
converges, then the integral Jp,\s, ((f 0 @)| det y’|)(t) dt also converges to the same 
value. If in addition | det y’| is defined and bounded on compact subsets of D;, then 
(f 0 @)| det y'|xs improperly integrable over the set D,, and the following equality 
holds: 


[, teoa= | ((f 0 )|dety’|)(t) dr. 
Dy Dj\S; 


Proof The assertion is a direct corollary of Theorem | and Theorem 2 of Sect. 11.5, 
provided we take account of the fact that when finding an improper integral over 
an open set one may restrict consideration to exhaustions that consist of measurable 
compact sets (see Remark 3). 


Example 5 Let us compute the integral [> ei ee 
integral when a > » since the integrand is unbounded in that case in a neighborhood 
of the disk x? + y* = 1. 


Passing to polar coordinates, we obtain from Theorem 2 


// ey al r dr dg 
eye dat ye J fopaar T= Pe 


For a > 0 this last integral is also improper, but, since the integrand is nonneg- 
ative, it can be computed as the limit over the special exhaustion of the rectangle 
I ={(r,g) € R*|0<@ <2 A0 <r <I} by the rectangles J, = {(r,g) € R? | 
0<@g<2r7A0<r<1- 1}, n &€N. Using Fubini’s theorem, we find that 


r dr dg ; s I-y ord a 
——— = lim a a ; 
ela (—r2 yn ~~ noo (1—r?) l-a 


By the same considerations, one can deduce that the original integral diverges for 
a>l. 


which is an improper 


Example 6 Let us show that the integral hi converges only under 


_dxdy _ 
Ix|+lyl21 |x|? +|y/4 
the condition 5 + ; <i. 


Proof In view of the obvious symmetry it suffices to consider the integral only over 
the domain D in which x > 0, y>Oandx+y>1. 

It is clear that the simultaneous conditions p > 0 and g > 0 are necessary for the 
integral to converge. Indeed, if p < 0 for example, we would obtain the following 
estimate for the integral over the rectangle [4 = {(x, y) € R2 |} 1<x<AAO<K< 
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y < 1} alone, which is contained in D: 


_ dxdy - : dy a dy 
dx | —~ =] ax 2 
IA \xlP + lylt Iya 1 o Ix|? +\yl? 1 o I+lyl? 
1 
d 
ae » | y 
o I+lyl? 


which shows that as A — oo, this integral increases without bound. Thus from now 
on we may assume that p > 0 and qg > 0. 

The integrand has no singularities in the bounded portion of the domain D, so that 
studying the convergence of this integral is equivalent to studying the convergence 
of the integral of the same function over, for example, the portion G of the domain 
D where x? + y? >a > 0. The number a can be assumed sufficiently large that the 
curve x? + y? =a lies in D for x > 0 and y > 0. 

Passing to generalized curvilinear coordinates g using the formulas 


1/p Nie 


i= (r cos” 9) y= (r sin? Q 


by Theorem 2 we obtain 


dx dy 2 Lily a ea 
If FEES = fh even” 7 “cos? gsin?  ) dr dg. 
a<r<oo 


Using the exhaustion of the domain {(r, g) € R? l\O0<g<am/2Aa<r<o} 
by intervals J;4 = {(7, g) € R? |O<e<@<am/2—€Aa<r <A} and applying 
Fubini’s theorem, we obtain 


ore! 2 2 
I wr cos? | wsina ' 9) dr dg = 
<o<n 


asr<oo 
m/2-€ 4 4 A Lat» 
= lim cos?’ gsing = gdg lim re'a “dr. 
e>0 Je A>0oo0 Jaq 


Since p > 0 and q > 0, the first of these limits is necessarily finite and the second 
is finite only when 7 + <i. 


11.6.4 Problems and Exercises 


1. Give conditions on p and q under which the integral Joetx yt heer con- 
verges. : 
2. a) Does the limit lim4_, 0 i cos x2 dx exist? 


b) Does the integral ie cos x7 dx converge in the sense of Definition 2? 
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c) By verifying that 


lim II sin(x* + y*)dxdy =z 
noo |x|<n 


and 


lim II sin(x? + y’) dx dy =0 
epee x24+y2<2rn 


verify that the integral of sin(x? + y”) over the plane R? diverges. 
: 1 pl pl dxdydz 
3. a) Compute the integral fy fy fo Sryqzr- 
b) One must be careful when applying Fubini’s theorem to improper integrals 


(but of course one must also be i when applying it to proper integrals). Show 


that the integral ff, , yet aa 


grals [7° dx fP° ao dy and {7° dy fr? can dx converge. 

c) Prove that if fEeCc (R*, R) and f => Oin IR’, then the existence of either of 
the iterated integrals f° dx f°. f(x, y)dy and f° dy f°. f(x, y) dx implies 
that the integral [’ ‘fp J (x, y) dx dy converges to the value of the iterated integral in 
question. 


4. Show that if f € C(R, R), then 


dx dy diverges, while both of the iterated inte- 


1 1 
lim — [ a —" _ fide = FO). 
5. Let D be a bounded domain in R” with a smooth boundary and S a smooth 
k-dimensional surface contained in the pound of D. Show that if the function 
f € C(D, R) admits the estimate | f| < == —— =, where d = d(S, x) is the distance 
from x € D to S and ¢ > 0, then the integral of f over D converges. 

6. As a supplement to Remark | show that it remains valid even if the set E is not 
assumed to be measurable. 

7. Let D be an open set in R” and let the function f : D — R be integrable over 
any measurable compact set contained in D. 


a) Show that if the improper integral of the function | f| over D diverges, then 
there exists an exhaustion {E,,} of D such that each set E,, is an elementary compact 
set, consisting of a finite number of n-dimensional intervals and E, | fl(x) dx > 
+00 asin — OO. 

b) Verify that if the integral of f oe a set converges yiils the integral of | f| 
diverges, then the integrals of f+ = 5 1 fl+f) and f- = 5 (sl = Ff) over the set 
both diverge. 

c) Show that the exhaustion {£,,} obtained in a) can be distributed in such a way 
that VEnci\Ey St (x) dx > Se, | f|(x) dx for alln EN. 


d) Using lower Darboux sums, show that if g f+(x) dx > A, then there exists 
an elementary compact set F C E consisting of a finite number of intervals such 
that f, f(x) dx > A. 
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e) Deduce from c) and d) that there exists an elementary compact set F,, C 
En+1\En for which Sr, f(x) dx > Sr, | fl(x) dx +n. 

f) Show using e) that the sets G, = F, M E, are elementary compact sets (that 
is, they consist of a finite number of intervals) contained in D that, taken together, 
constitute an exhaustion of D, and for which the relation fi G, f(x) dx — +00 as 
n — oo holds. 


Thus, if the integral of | f| diverges, then the integral of f (in the sense of Defi- 
nition 2) also diverges. 
8. Carry out the proof of Theorem 2 in detail. 
9. We recall that if x = (x!,...,x”) and € = (é€!,...,&”), then (x,é) =xlé! + 
--» + x"&" is the standard inner product in R”. Let A = (a;;) be a symmetric 
n X n matrix of complex numbers. We denote by Re A the matrix with elements 
Rea;;. Writing Re A > 0 (resp. Re A > 0) means that ((Re A)x,x) > 0 (resp. 
((Re A)x, x) > 0) for every x € R”, x £0. 


a) Show that if Re A > 0, then for 4 > 0 and € € R” we have 


[ exp( =F (Ax, —i(x, 2) dx = 


Qn \"/? 7 os 
-(=) (det A) "exp(—(A 's.4)) 


Here the branch of det A is chosen as follows: 
(det A)~!/? = | det A|~!/? exp(—i Ind A), 
i TU 
IndA =>) Varguj(A), —_ farguj(A)| < 5, 
j=l 


where 1 ;(A) are the eigenvalues of A. 
b) Let A be a real-valued symmetric nondegenerate (n x n) matrix. Then for 
— € R” and A > 0 we have 


/ exp(i5 (Ax, x) —ite.4)) = 


2 n/2 . . 
= (=) | det A|~!/2 exo( = (Arle, :)) exp( sen). 


Here sgn A is the signature of the matrix, that is, 
sgn A = v4(A) — v_(A), 


where v,(A) is the number of positive eigenvalues of A and v_(A) the number of 
negative eigenvalues. 


Chapter 12 
Surfaces and Differential Forms in IR” 


In this chapter we discuss the concepts of surface, boundary of a surface, and con- 
sistent orientation of a surface and its boundary; we derive a formula for computing 
the area of a surface lying in IR”; and we give some elementary information on dif- 
ferential forms. Mastery of these concepts is very important in working with line 
and surface integrals, to which the next chapter is devoted. 


12.1 Surfaces in R” 


The standard model for a k-dimensional surface is R*. 


Definition 1 A surface of dimension k (or k-dimensional surface or k-dimensional 
manifold) in R” is a subset S C R” each point of which has a neighborhood! in S 
homeomorphic? to R*. 


Definition 2 The mapping y : R‘ > U C S provided by the homeomorphism re- 
ferred to in the definition of a surface is called a chart or a local chart of the sur- 
face S, R* is called the parameter domain, and U is the range or domain of action 
of the chart on the surface S. 


A local chart introduces curvilinear coordinates in U by assigning to the point 
x = y(t) € U the set of numbers t = (t!,...,t*) € R*. It is clear from the definition 
that the set of objects § described by the definition does not change if R* is replaced 


‘As before, a neighborhood of a point x € S C R” in S is a set Us (x) = SOU (x), where U(x) isa 
neighborhood of x in IR”. Since we shall be discussing only neighborhoods of a point on a surface 
in what follows, we shall simplify the notation where no confusion can arise by writing U or U(x) 
instead of Us(x). 

2On S C R” and hence also on U C S there is a unique metric induced from R”, so that one can 
speak of a topological mapping of U into R*. 
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in it by any topological space homeomorphic to R*. Most often the standard param- 
eter region for local charts is assumed to be an open cube /* or an open ball Bé 
in R*. But this makes no substantial difference. 

To carry out certain analogies and in order to make a number of the following 
constructions easier to visualize, we shall as a rule take a cube [ K as the canonical 
parameter domain for local charts on a surface. Thus a chart 


eel SO cCs (12.1) 


gives a local parametric equation x = g(t) for the surface S C R”, and the k- 
dimensional surface itself thus has the local structure of a deformed standard k- 
dimensional interval 7‘ C R”. 

The parametric definition of a surface is especially important for computational 
purposes, as will become clear below. Sometimes one can define the entire surface 
by a single chart. Such a surface is usually called elementary. For example, the graph 
of a continuous function f : /* > R in R**! is an elementary surface. However, 
elementary surfaces are more the exception than the rule. For example, our ordinary 
two-dimensional terrestrial sphere cannot be defined by only one chart. An atlas of 
the surface of the Earth must contain at least two charts (see Problem 3 at the end of 
this section). 

In accordance with this analogy we adopt the following definition. 


Definition 3 A set A(S) := {g; : ie — U;,i € N} of local charts of a surface S$ 
whose domains of action together cover the entire surface (that is, S = (; Uj) is 
called an atlas of the surface S. 


The union of two atlases of the same surface is obviously also an atlas of the 
surface. 

If no restrictions are imposed on the mappings (12.1), the local parametrizations 
of the surface, except that they must be homeomorphisms, the surface may be situ- 
ated very strangely in IR”. For example, it can happen that a surface homeomorphic 
to a two-dimensional sphere, that is, a topological sphere, is contained in R°, but 
the region it bounds is not homeomorphic to a ball (the so-called Alexander horned 
sphere).° 

To eliminate such complications, which have nothing to do with the questions 
considered in analysis, we defined a smooth k-dimensional surface in R” in Sect. 8.7 
to be a set S C R” such that for each xo € S there exists a neighborhood U (xo) 
in R” and a diffeomorphism yw : U(x9) > I” = {t € R” | |t| < 1,i=1,...,n} un- 
der which the set Us(xo) := S. U(xo) maps into the cube /* = J” A {t € R” | 


tet! =.= 7" = 0}. 
It is clear that a surface that is smooth in this sense is a surface in the sense 
of Definition 1, since the mappings x = void, ...,t*,0,...,0) = g(t}, ; at) 


3An example of the surface described here was constructed by the American topologist 
J.W. Alexander (1888-1977). 
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obviously define a local parametrization of the surface. The converse, as follows 
from the example of the horned sphere mentioned above, is generally not true, if 
the mappings g are merely homeomorphisms. However, if the mappings (12.1) are 
sufficiently regular, the concept of a surface is actually the same in both the old and 
new definitions. 

In essence this has already been shown by Example 8 in Sect. 8.7, but considering 
the importance of the question, we give a precise statement of the assertion and 
recall how the answer is obtained. 


Proposition If the mapping (12.1) belongs to class CY I‘, R") and has maximal 
rank at each point of the cube I*, there exists a number ¢ > 0 and a diffeomorphism 
g, : 12 — R" of the cube If := {t € R" | |t'| < e;,i =1,...,n} of dimension n 
in R" such that Plrkaie = Pela: 


In other words, it is asserted that under these hypotheses the mappings (12.1) are 
locally the restrictions of diffeomorphisms of the full-dimensional cubes /? to the 
k-dimensional cubes ibs = IF nq If. 


Proof Suppose for definiteness that the first k of the n coordinate functions xk = 
gy! (t!,...,t*),i=1,...,n, of the mapping x = ¢(f) are such that det(24)(0) #0, 
i,j =1,...,k. Then by the implicit function theorem the relations 


eat at); 
kt ere, ), 
x =e"(t!,...,t%) 


near the point (to, x9) = (0, p(O)) are equivalent to relations 


PSP Ue eed) 
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In this case the mapping 


faa” — f(x x") 


is a diffeomorphism of a full-dimensional neighborhood of the point xp € R”. As @- 
we can now take the restriction to some cube J!’ of the diffeomorphism inverse to 
it. 


By a change of scale, of course, one can arrange to have ¢ = | and a unit cube 
I? in the last diffeomorphism. 

Thus we have shown that for a smooth surface in R” one can adopt the following 
definition, which is equivalent to the previous one. 


Definition 4 The k-dimensional surface in R” introduced by Definition | is smooth 
(of class C™, m > 1) if it has an atlas whose local charts are smooth mappings (of 
class C™, m > 1) and have rank k at each point of their domains of definition. 


We remark that the condition on the rank of the mappings (12.1) is essential. For 
example, the analytic mapping R 5 t + (x!, x*) € R? defined by x! = 17, x7 = #3 
defines a curve in the plane R* having a cusp at (0, 0). It is clear that this curve is 
not a smooth one-dimensional surface in R?, since the latter must have a tangent 
(a one-dimensional tangent plane) at each point.* 

Thus, in particular one should not conflate the concept of a smooth path of class 
C and the concept of a smooth curve of class C”. 

In analysis, as a rule, we deal with rather smooth parametrizations (12.1) of 
rank k. We have verified that in this case Definition 4 adopted here for a smooth 
surface agrees with the one considered earlier in Sect. 8.7. However, while the pre- 
vious definition was intuitive and eliminated certain unnecessary complications im- 
mediately, the well-known advantage of Definition 4 of a surface, in accordance 
with Definition 1, is that it can easily be extended to the definition of an abstract 
manifold, not necessarily embedded in R”. For the time being, however, we shall be 
interested only in surfaces in R”. 

Let us consider some examples of such surfaces. 


4For the tangent plane see Sect. 8.7. 
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Example I We recall that if Fi eC™ (R",R),i=1,...,n—k, isa set of smooth 
functions such that the system of equations 


(12.2) 
OE a cue) =0 


has rank n — k at each point in the set S of its solutions, then either this system 
has no solutions at all or the set of its solutions forms a k-dimensional C“)-smooth 
surface S in R”. 


Proof We shall verify that if S 4 @, then S does indeed satisfy Definition 4. This 
follows from the implicit function theorem, which says that in some neighborhood 
of each point x9 € S the system (12.2) is equivalent, up to a relabeling of the vari- 
ables, to a system 


xhtl — phtl (yl _ x*) 


CaP naa) 


where f*+!,..., f” €C. By writing this last system as 
Pe ae 
xk = 
k+l _ ‘el a t*) 


PSP cal”), 


we atrive at a parametric equation for the neighborhood of the point xo € S on S. 
By an additional transformation one can obviously turn the domain into a canonical 
domain, for example, into J * and obtain a standard local chart (12.1). 


Example 2 In particular, the sphere defined in R” by the equation 
(x! P4--4(x"P =r? © >0) (12.3) 


is an (n — 1)-dimensional smooth surface in IR” since the set S of solutions of 
Eq. (12.3) is obviously nonempty and the gradient of the left-hand side of (12.3) 
is nonzero at each point of S. 
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When n = 2, we obtain the circle in R? given by 
(P+ Par, 


which can easily be parametrized locally by the polar angle @ using the polar coor- 
dinates 


x! =rcos0, 


x?=rsind. 

For fixed r > 0 the mapping 6 +> (x!, x7)(@) is a diffeomorphism on every inter- 
val of the form 69 < 6 < 69 + 27, and two charts (for example, those corresponding 
to values 09 = 0 and 6) = —77) suffice to produce an atlas of the circle. We could not 
get by with one canonical chart (12.1) here because a circle is compact, in contrast 
to R! or J! = B!, and compactness is invariant under topological mappings. 

Polar (spherical) coordinates can also be used to parametrize the two-dimensional 
sphere 


(I+ G4 (Pr 


in R>. Denoting by yw the angle between the direction of the vector (x!, x”, x3) and 
the positive x>-axis (that is, 0 < w <) and by g the polar angle of the projection 
of the radius-vector (x!, x?, x3) onto the (x!, x*)-plane, we obtain 


x3=rcosy, 


x2=rsiny sing, 


x! =rsinycosg. 


In general polar coordinates (r, 6,,...,6,— ,) in R” are introduced via the rela- 
tions 


x! =rcos6, 


=r sin 6; cos 02, 


(12.4) 
x"! =r sin6, sin) -...- sinO@,_2 C08 On—1, 
x” =rsin@, sin@)-...-sin@,—1 sinO@,_1- 
We recall the Jacobian 
J =r"! sin"~? 6; sin’~3 6) -...- sin@,_2 (12.5) 
for the transition (12.4) from polar coordinates (r, 01,...,,—1) to Cartesian coor- 
dinates (x!,...,x”) in R”. It is clear from the expression for the Jacobian that it is 
nonzero if, for example, 0 <6; <2,i=1,...,n—2, andr > 0. Hence, even with- 


out invoking the simple geometric meaning of the parameters 6), ..., 0,1, one can 
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Fig. 12.1 
guarantee that for a fixed r > 0 the mapping (61, ..., A@,—1) b> (x!, ..., x”), being 
the restriction of a local diffeomorphism (7, 61, ..., @n—1) (x!, ...,X"”) is itself a 


local diffeomorphism. But the sphere is homogeneous under the group of orthogo- 
nal transformations of R”, so that the possibility of constructing a local chart for a 
neighborhood of any point of the sphere now follows. 
Example 3 The cylinder 

(x!) feet (x*)? =r* (r>0), 


for k <n is an (n — 1)-dimensional surface in R” that is the direct product of the 


(k — 1)-dimensional sphere in the plane of the variables (xt, ..., xk ) and the (n — k)- 
dimensional plane of the variables (x**+!, ..., x”). 

A local parametrization of this surface can obviously be obtained if we take 
the first k — 1 of the n — 1 parameters (t!,...,¢”~!) to be the polar coordinates 
01,..., Ox—1 Of a point of the (k — 1)-dimensional sphere in R* and set t*,..., 47! 
equal to x*+!, ..., x” respectively. 


Example 4 If we take a curve (a one-dimensional surface) in the plane x = 0 of R? 
endowed with Cartesian coordinates (x, y, z), and the curve does not intersect the 
Z-axis, we can rotate the curve about the z-axis and obtain a 2-dimensional surface. 
The local coordinates can be taken as the local coordinates of the original curve (the 
meridian) and, for example, the angle of revolution (a local coordinate on a parallel 
of latitude). 

In particular, if the original curve is a circle of radius a with center at (b, 0, 0), 
for a < b we obtain the two-dimensional torus (Fig. 12.1). Its parametric equation 
can be represented in the form 


x =(b+acosw)cos¢, 
y=(b+acosw) sing, 
z=asiny, 


where vy is the angular parameter on the original circle — the meridian — and ¢ is the 
angle parameter on a parallel of latitude. 


It is customary to refer to any surface homeomorphic to the torus of revolution 
just constructed as a torus (more precisely, a two-dimensional torus). As one can 
see, a two-dimensional torus is the direct product of two circles. Since a circle can 
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Fig. 12.2 


be obtained from a closed interval by gluing together (identifying) its endpoints, 
a torus can be obtained from the direct product of two closed intervals (that is, a 
rectangle) by gluing the opposite sides together at corresponding points (Fig. 12.2). 

In essence, we have already made use of this device earlier when we established 
that the configuration space of a double pendulum is a two-dimensional torus, and 
that a path on the torus corresponds to a motion of the pendulum. 


Example 5 If a flexible ribbon (rectangle) is glued along the arrows shown 
in Fig. 12.3a, one can obtain an annulus (Fig. 12.3c) or a cylindrical surface 
(Fig. 12.3b), which are the same from a topological point of view. (These two sur- 
faces are homeomorphic.) But if the ribbon is glued together along the arrows shown 
in Fig. 12.4a, we obtain a surface in R? (Fig. 12.4b) called a Mébius band. 

Local coordinates on this surface can be naturally introduced using the coordi- 
nates on the plane in which the original rectangle lies. 


Example 6 Comparing the results of Examples 4 and 5 in accordance with the nat- 
ural analogy, one can now prescribe how to glue a rectangle (Fig. 12.5a) that com- 
bines elements of the torus and elements of the Mébius band. But, just as it was 
necessary to go outside R? in order to glue the Mobius band without tearing or self- 
intersections, the gluing prescribed here cannot be carried out in R*. However, this 
can be done in R’, resulting in a surface in R* usually called the Klein bottle.© An 
attempt to depict this surface has been undertaken in Fig. 12.5b. 
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Fig. 12.3 


5 A.F. Mobius (1790-1868) — German mathematician and astronomer. 


®RCh. Klein (1849-1925) — outstanding German mathematician, the first to make a rigorous in- 
vestigation of non-Euclidean geometry. An expert in the history of mathematics and one of the 
organizers of the “Encyclopadie der mathematischen Wisaenschaftm”. 
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Fig. 12.4 SATIS 
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Fig. 12.5 
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This last example gives some idea of how a surface can be intrinsically described 
more easily than the same surface lying in a particular space IR”. Moreover, many 
important surfaces (of different dimensions) originally arise not as subsets of R”, 
but, for example, as the phase spaces of mechanical systems or the geometric image 
of continuous transformation groups of automorphisms, as the quotient spaces with 
respect to groups of automorphisms of the original space, and so on, and so forth. 
We confine ourselves for the time being to these introductory remarks, waiting to 
make them more precise until Chap. 15, where we shall give a general definition 
of a surface not necessarily lying in R”. But already at this point, before the def- 
inition has even been given, we note that by a well-known theorem of Whitney’ 
any k-dimensional surface can be mapped homeomorphically onto a surface ly- 
ing in R2*+!, Hence in considering surfaces in R” we really lose nothing from the 
point of view of topological variety and classification. These questions, however, 
are somewhat off the topic of our modest requirements in geometry. 


12.1.1 Problems and Exercises 


1. For each of the sets Ey given by the conditions 


(x,y) €R*|x?-y* =a}, 


a= 


(x,y,z) €R? | x? -y? =a}, 


a= 


{ 
{ 
a= (Gy. JER |x? +y?—2 =a}, 
[zeC||z?—1| =a}, 


a= 


7H. Whitney (1907-1989) — American topologist, one of the founders of the theory of fiber bun- 
dles. 
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depending on the value of the parameter a € R, determine 


a) whether E, is a surface; 
b) if so, what the dimension of E, is; 
c) whether E, is connected. 


2. Let f :R” — R” be a smooth mapping satisfying the condition f o f = f. 


a) Show that the set f(R”) is a smooth surface in R”. 
b) By what property of the mapping f is the dimension of this surface deter- 
mined? 


3. Let e9, €1,..., @n be an orthonormal basis in the Euclidean space R't! letx= 
x°eg9 +x $e] +---+2x"en, let {x} be the point (x9, x!,...,x”), and let e),...,e, be 
a basis in R” cC R"t!, 

The formulas 


x — xe e 


Wi a 1 0) for x # €0, w= “a. 
SX X 


define the stereographic projections 
yi: S"\{eo} > R", y : S"\{—e0} > R" 


from the points {e9} and {—eo} respectively. 


a) Determine the geometric meaning of these mappings. 
b) Verify that if t ¢ R” and ¢ 4 0, then (¥2 0 W,')(t) = ae where yj! = 


(Wils,\feo)) 

c) Show that the two charts vy! = 9, : R"” > S"\{eo} and vy! =@:R" > 
S"\{—eo} form an atlas of the sphere S” C R"t!, 

d) Prove that every atlas of the sphere must have at least two charts. 


12.2 Orientation of a Surface 


We recall first of all that the transition from one frame e),...,e, in R” to a sec- 
ond frame €;,...,€, is effected by means of the square matrix obtained from the 
expansions €; = a‘.e;. The determinant of this matrix is always nonzero, and the set 
of all frames divides into two equivalence classes, each class containing all possi- 
ble frames such that for any two of them the determinant of the transition matrix is 
positive. Such equivalence classes are called orientation classes of frames in R”. 

To define an orientation means to fix one of these orientation classes. Thus, the 
oriented space R" is the space R” itself together with a fixed orientation class of 
frames. To specify the orientation class it suffices to exhibit any of the frames in it, 
so that one can also say that the oriented space R” is R” together with a fixed frame 
in it. 
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Fig. 12.6 


A frame in R” generates a coordinate system in R”, and the transition from one 
such coordinate system to another is effected by the matrix (a! ) that is the transpose 
of the matrix (a‘) that connects the two frames. Since the determinants of these 
two matrices are the same, everything that was said above about orientation can be 
repeated on the level of orientation classes of coordinate systems in R", placing in 
one class all the coordinate systems such that the transition matrix between any two 
systems in the same class has a positive Jacobian. 

Both of these essentially identical approaches to describing the concept of an 
orientation in R” will also manifest themselves in describing the orientation of a 
surface, to which we now turn. 

We recall, however, another connection between coordinates and frames in the 
case of curvilinear coordinate systems, a connection that will be useful in what is to 
follow. 

Let G and D be diffeomorphic domains lying in two copies of the space R” en- 
dowed with Cartesian coordinates (x!,..., x”) and (t!,..., 1”) respectively. A dif- 
feomorphism g : D — G can be regarded as the introduction of curvilinear coordi- 
nates (t!,..., tf”) into the domain G via the rule x = y(t), that is, the point x € G 
is endowed with the Cartesian coordinates (t!,..., t”) of the point ¢t = g7! (x) ED. 
If we consider a frame ej,...,e, of the tangent space TR? at each point t ¢ D 
composed of the unit vectors along the coordinate directions, a field of frames 
arises in D, which can be regarded as the translations of the orthogonal frame of 
the original space R” containing D, parallel to itself, to the points of D. Since 
gy: D—= G is a diffeomorphism, the mapping g'(t) : TD; > TGy=g) of tangent 
spaces effected by the rule TD; 3 e+ g'(t)e = & € TGy, is an isomorphism of the 
tangent spaces at each point t. Hence from the frame e),...,e, in TD; we obtain 
a frame &; ='(t)e1,...,&, =’ (te, in TG,, and the field of frames on D trans- 
forms into a field of frames on G (see Fig. 12.6). Since g € CD, G), the vector 
field &(x) = &(g(t)) = g’(t)e(t) is continuous in G if the vector field e(t) is con- 
tinuous in D. Thus every continuous field of frames (consisting of n continuous 
vector fields) transforms under a diffeomorphism to a continuous field of frames. 
Now let us consider a pair of diffeomorphisms g; : Dj > G, i = 1,2, which in- 
troduce two systems of curvilinear coordinates (1, ...,¢7/) and (th, ..., 0) into the 
same domain G. The mutually inverse diffeomorphisms ¢, lo gy, : Dj > D> and 


9; | 0 g2 : Dz — Dy provide mutual transitions between these coordinate systems. 
The Jacobians of these mappings at corresponding points of D; and D2 are mutually 
inverse to each other and consequently have the same sign. If the domain G (and 
together with it D; and D2) is connected, then by the continuity and nonvanishing 


174 12 Surfaces and Differential Forms in R” 


of the Jacobians under consideration, they have the same sign at all points of the 
domains D; and D2 respectively. 

Hence the set of all curvilinear coordinate systems introduced in a connected do- 
main G by this method divide into exactly two equivalence classes when each class 
is assigned systems whose mutual transitions are effected with a positive Jacobian. 
Such equivalence classes are called the orientation classes of curvilinear coordinate 
systems in G. 

To define an orientation in G means by definition to fix an orientation class of its 
curvilinear coordinate systems. 

It is not difficult to verify that curvilinear coordinate systems belonging to the 
same orientation class generate continuous fields of frames in G (as described 
above) that are in the same orientation class of the tangent space TG, at each point 
x € G. It can be shown in general that, if G is connected, the continuous fields of 
frames on G divide into exactly two equivalence classes if each class is assigned 
the fields whose frames belong to the same orientation class of frames of the space 
TG, at each point x € G (in this connection, see Problems 3 and 4 at the end of this 
section). 

Thus the same orientation of a domain G can be defined in two completely equiv- 
alent ways: by exhibiting a curvilinear coordinate system in G, or by defining any 
continuous field of frames in G, all belonging to the same orientation class as the 
field of frames generated by this coordinate system. 

It is now clear that the orientation of a connected domain G is completely de- 
termined if a frame that orients TG, is prescribed at even one point x € G. This 
circumstance is widely used in practice. If such an orienting frame is defined at 
some point x9 € G, and a curvilinear coordinate system g : D — G is taken in G, 
then after constructing the frame induced by this coordinate system in TG,,, we 
compare it with the orienting frame in TG,. If the two frames both belong to the 
same orientation class of TG,,, we regard the curvilinear coordinates as defining 
the same orientation on G as the orienting frame. Otherwise, we regard them as 
defining the opposite orientation. 

If G is an open set, not necessarily connected, since what has just been said is 
applicable to any connected component of G, it is necessary to define an orienting 
frame in each component of G in order to orient G. Hence, if there are m compo- 
nents, the set G admits 2” different orientations. 

What has just been said about the orientation of adomain G C R” can be repeated 
verbatim if instead of the domain G we consider a smooth k-dimensional surface S$ 
in R” defined by a single chart (see Fig. 12.7). In this case the curvilinear coordinate 
systems on S also divide naturally into two orientation classes in accordance with 
the sign of the Jacobian of their mutual transition transformations; fields of frames 
also arise on S; and the orientation can also be defined by an orienting frame in 
some tangent plane TS, to S. 

The only new element that arises here and requires verification is the implicitly 
occurring proposition that follows. 


12.2 Orientation of a Surface 15 


Fig. 12.7 FPR 
L? 


qk 


Proposition 1 The mutual transitions from one curvilinear coordinate system to 
another on a smooth surface S C R" are diffeomorphisms of the same degree of 
smoothness as the charts of the surface. 


Proof In fact, by the proposition in Sect. 12.1, we can regard any chart Ik > UC 
S locally as the restriction to [ Kr O(t) of a diffeomorphism F : O(t) > O(x) 
from some n-dimensional neighborhood O(t) of the point t € J C R” to an n- 
dimensional neighborhood O(x) of x €¢ S C R”, F being of the same degree of 
smoothness as g. If now ¢ : a — U, and qg: Ik — Up are two such charts, then 
the action of the mapping 9, are ¢ (the transition from the first coordinate system 
to the second) which arises in wee common domain of action can be represented 
locally as Q;! fc) gi(t!,. th) = GFE e258" 0 ,0), where F; and F> 
are the corresponding eer of the n- dimensional neighborhoods. 


We have studied all the essential components of the concept of an orientation 
of a surface using the example of an elementary surface defined by a single chart. 
We now finish up this business with the final definitions relating to the case of an 
arbitrary smooth surface in R”. 

Let S be a smooth k-dimensional surface in R”, and let 9; : J; k_. Uj, 9; Pe VT; ay 
U; be two local charts of the surface S whose domains of action intersect, that i is, 
U; 1U; 4 @. Then between the sets Ke = yg, '(Uj) and i= = 9; (Ui), as was just 
proved, there are natural mutually inverse sGtteciasishitins Qij: Ti, a Vii kK and Pji: 


Ti a Tj k that realize the transition from one local curvilinear coardiaate as on 
s to the other. 


Definition 1 Two local charts of a surface are consistent if their domains of ac- 
tion either do not intersect, or have a nonempty intersection for which the mutual 
transitions are effected by diffeomorphisms with positive Jacobian in their common 
domain of action. 


Definition 2 An atlas of a surface is an orienting atlas of the surface if it consists 
of pairwise consistent charts. 
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Definition 3 A surface is orientable if it has an orienting atlas. Otherwise it is 
nonorientable. 


In contrast to domains of R” or elementary surfaces defined by a single chart, an 
arbitrary surface may turn out to be nonorientable. 


Example I The Mobius band, as one can verify (see Problems 2 and 3 at the end of 
this section), is a nonorientable surface. 


Example 2 The Klein bottle is also a nonorientable surface, since it contains a 
Mobius band. This last fact can be seen immediately from the construction of the 
Klein bottle shown in Fig. 12.5. 


Example 3 A circle and in general a k-dimensional sphere are orientable, as can be 
proved by exhibiting directly an atlas of the sphere consisting of consistent charts 
(see Example 2 of Sect. 12.1). 


Example 4 The two-dimensional torus studied in Example 4 of Sect. 12.1 is also an 
orientable surface. Indeed, using the parametric equations of the torus exhibited in 
Example 4 of Sect. 12.1, one can easily exhibit an orienting atlas for it. 


We shall not go into detail, since a more visualizable method of controlling the 
orientability of sufficiently simple surfaces will be exhibited below, making it easy 
to verify the assertions in Examples 1-4. 

The formal description of the concept of orientation of a surface will be finished 
if we add Definitions 4 and 5 below to Definitions 1, 2, and 3. 

Two orienting atlases of a surface are equivalent if their union is also an orienting 
atlas of the surface. 

This relation is indeed an equivalence relation between orienting atlases of an 
orientable surface. 


Definition 4 An equivalence class of orienting atlases of a surface under this rela- 
tion is called an orientation class of atlases or simply an orientation of the surface. 


Definition 5 An oriented surface is a surface with a fixed orientation class of atlases 
(that is, a fixed orientation of the surface). 


Thus orienting a surface means exhibiting a particular orientation class of ori- 
enting atlases of the surface by some means or other. 

Some special manifestations of the following proposition are already familiar to 
us. 


Proposition 2 There exist precisely two orientations on a connected orientable sur- 
face. 
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They are usually called opposite orientations. 

The proof of Proposition 2 will be given in Sect. 15.2.3. 

If an orientable surface is connected, an orientation of it can be defined by speci- 
fying any local chart of the surface or an orienting frame in any of its tangent planes. 
This fact is widely used in practice. 

When a surface has more than one connected component, such a local chart or 
frame is naturally to be exhibited in each component. 

The following way of defining an orientation of a surface embedded in a space 
that already carries an orientation is widely used in practice. Let S' be an orientable 
(n — 1)-dimensional surface embedded in the Euclidean space R” with a fixed ori- 
enting frame e;,...,e, in R”. Let TS, be the (m — 1)-dimensional plane tangent 
to S at x € S, and n the vector orthogonal to 7S;,., that is, the vector normal to the 
surface S at x. If we agree that for the given vector n the frame &,,..., &,,_; is to be 
chosen in TS; so that the frames (e1,...,@,) and (n, &,,...,&,_1) = (@1,..., €n) 
belong to the same orientation class on R”, then, as one can easily see, such frames 
(€,,...,&,) of the plane 7S, will themselves all turn out to belong to the same ori- 
entation class for this plane. Hence in this case defining an orientation class for TS, 
and along with it an orientation on a connected orientable surface can be done by 
defining the normal vector n (Fig. 12.8). 

It is not difficult to verify (see Problem 4) that the orientability of an (” — 1)- 
dimensional surface embedded in the Euclidean space R” is equivalent to the exis- 
tence of a continuous field of nonzero normal vectors on the surface. 

Hence, in particular, the orientability of the sphere and the torus follow obviously, 
as does the nonorientability of the Mobius band, as was stated in Examples 1-4. 

In geometry the connected (n — 1)-dimensional surfaces in the Euclidean space 
R” on which there exists a (single-valued) continuous field of unit normal vectors 
are called two-sided. 

Thus, for example, a sphere, torus, or plane in R? is a two-sided surface, in 
contrast to the Mébius band, which is a one-sided surface in this sense. 

To finish our discussion of the concept of orientation of a surface, we make sev- 
eral remarks on the practical use of this concept in analysis. 

In the computations that are connected in analysis with oriented surfaces in R” 
one usually finds first some local parametrization of the surface S without bothering 
about orientation. In some tangent plane TS, to the surface one then constructs a 
frame &,,...,&,_1 consisting of (velocity) vectors tangent to the coordinate lines 
of a chosen curvilinear coordinate system, that is, the orienting frame induced by 
this coordinate system. 
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If the space R” has been oriented and an orientation of S has been defined by a 
field of normal vectors, one chooses the vector n of the given field at the point x 
and compares the frame n, €,,...,&,_, with the frame e1,...,e, that orients the 
space. If these are in the same orientation class, the local chart defines the required 
orientation of the surface in accordance with our convention. If these two frames are 
inconsistent, the chosen chart defines an orientation of the surface opposite to the 
one prescribed by the normal n. 

It is clear that when there is a local chart of an (n — 1)-dimensional surface, one 
can obtain a local chart of the required orientation (the one prescribed by the fixed 
normal vector n to the two-sided hypersurface embedded in the oriented space R”) 
by a simple change in the order of the coordinates. 

In the one-dimensional case, in which a surface is a curve, the orientation is more 
often defined by the tangent vector to the curve at some point; in that case we often 
say the direction of motion along the curve rather than “the orientation of the curve”. 

If an orienting frame has been chosen in R* and a closed curve is given, the 
positive direction of circuit around the domain D bounded by the curve is taken to 
be the direction such that the frame n, v, where n is the exterior normal to the curve 
with respect to D and v is the velocity of the motion, is consistent with the orienting 
frame in R?. 

This means, for example, that for the traditional frame drawn in the plane a pos- 
itive circuit is “counterclockwise”, in which the domain is always “on the left’. 

In this connection the orientation of the plane itself or of a portion of the plane 
is often defined by giving the positive direction along some closed curve, usually a 
circle, rather than a frame in R2. 

Defining such a direction amounts to exhibiting the direction of shortest rota- 
tion from the first vector in the frame until it coincides with the second, which is 
equivalent to defining an orientation class of frames on the plane. 


12.2.1 Problems and Exercises 


1. Is the atlas of the sphere exhibited in Problem 3c) of Sect. 12.1 an orienting atlas 
of the sphere? 
2. a) Using Example 4 of Sect. 12.1, exhibit an orienting atlas of the two- 
dimensional torus. 

b) Prove that there does not exist an orienting atlas for the Mobius band. 

c) Show that under a diffeomorphism f : D> D an orientable surface $ C D 
maps to an orientable surface vee ie 


3. a) Verify that the curvilinear coordinate systems on a domain G C R” belonging 
to the same orientation class generate continuous fields of frames in G that deter- 
mine frames of the same orientation class on the space TG, at each point x € G. 

b) Show that in a connected domain G C R” the continuous fields of frames 
divide into exactly two orientation classes. 
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c) Use the example of the sphere to show that a smooth surface S C IR” may be 
orientable even those there is no continuous field of frames in the tangent spaces 
to S. 

d) Prove that on a connected orientable surface one can define exactly two dif- 
ferent orientations. 


4. a) A subspace R”~! has been fixed, a vector V € R”\R"—! has been chosen, 
along with two frames (&),...,&,—) and (&),...,&,;) of the subspace R"~!. 
Verify that these frames belong to the same orientation class of frames of R'-! 
if and only if the frames (v, &,,...,&,_ 1) and (v,&),...,&,_ 1) define the same 
orientation on R”. 

b) Show that a smooth hypersurface S$ C R” is orientable if and only if there 
exists a continuous field of unit normal vectors to S. Hence, in particular, it follows 
that a two-sided surface is orientable. 

c) Show that if grad F ¥ 0, then the surface defined by F(x!,..., x’) = 0 is 
orientable (assuming that the equation has solutions). 

d) Generalize the preceding result to the case of a surface defined by a system 
of equations. 

e) Explain why not every smooth two-dimensional surface in RR? can be defined 
by an equation F(x, y, z) = 0, where F is a smooth surface having no critical points 
(a surface for which grad F ¥ 0 at all points). 


12.3 The Boundary of a Surface and Its Orientation 


12.3.1 Surfaces with Boundary 


Let IR* be a Euclidean space of dimension k endowed with Cartesian coordinates 
t!,...,t*. Consider the half-space H* := {t € R* | t! < 0} of the space R*. The hy- 
perplane 0H* := {t € R* | t! = 0} will be called the boundary of the half-space H*. 

We remark that the set H* := H*\dH*, that is, the open part of H*, is an ele- 
mentary k-dimensional surface. The half-space H* itself does not formally satisfy 
the definition of a surface because of the presence of the boundary points from 0H". 
The set H* is the standard model for surfaces with boundary, which we shall now 
describe. 


Definition 1 A set S C R” is a (k-dimensional) surface with boundary if every point 
x € § has a neighborhood U in § homeomorphic either to R* or to H*. 


Definition 2 Ifa point x € U corresponds to a point of the boundary @H* under the 
homeomorphism of Definition 1, then x is called a boundary point of the surface 
(with boundary) S and of its neighborhood U. The set of all such boundary points 
is called the boundary of the surface S. 
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As atule, the boundary of a surface S will be denoted 0S. We note that for k = | 
the space dH* consists of a single point. Hence, preserving the relation 0H* = 
R‘—!, we shall from now on take R° to consist of a single point and regard dR° as 
the empty set. 

We recall that under a homeomorphism ;; : G; > Gj of the domain G; C Ré 
onto the domain Gj; C R* the interior points of G; map to interior points of the im- 
age gj; (G;) (this is a theorem of Brouwer). Consequently, the concept of a boundary 
point of the surface is independent of the choice of the local chart, that is, the con- 
cept is well defined. 

Formally Definition 1 includes the case of the surface described in Definition 1 
of Sect. 12.1. Comparing these definitions, we see that if S has no boundary points, 
we return to our previous definition of a surface, which can now be regarded as 
the definition of a surface without boundary. In this connection we note that the 
term “surface with boundary” is normally used when the set of boundary points is 
nonempty. 

The concept of a smooth surface S (of class C“)) with boundary can be intro- 
duced, as for surfaces without boundary, by requiring that S have an atlas of charts of 
the given smoothness class. When doing this we assume that for charts of the form 
gy : H* — U the partial derivatives of y are computed at points of the boundary 
dH* only over the domain H* of definition of the mapping ¢, that is, these deriva- 
tives are sometimes one-sided, and that the Jacobian of the mapping g is nonzero 
throughout H*. 

Since R* can be mapped to the cube /* = {rt € R¥ | |t'| < 1,i=1,...,k} bya 
diffeomorphism of class C‘°° and in such a way that H* maps to the portion J , of 
the cube /* defined by the additional condition t! < 0, it is clear that in the definition 
of a surface with boundary (even a smooth one) we could have replaced R* by I* 
and H* by rm or by the cube T* with one of its faces attached: [*~! := {te R* | 
t! =1, |t'| <1,i=2,...,k}, which is obviously a cube of dimension one less. 

Taking account of this always-available freedom in the choice of canonical local 
charts of a surface, comparing Definitions | and 2 and Definition | of Sect. 12.1, we 
see that the following proposition holds. 


Proposition 1 The boundary of a k-dimensional surface of class C™ is itself a 
surface of the same smoothness class, and is a surface without boundary having 
dimension one less than the dimension of the original surface with boundary. 


Proof Indeed, if A(S) = {(H*, g;, U;)}U{(R*, gj, U;)} is an atlas for the surface S 
with boundary, then A(dS) = {(R‘!, PilaHkapk-1, 0U;)} is obviously an atlas of 
the same smoothness class for 0S. 


We now give some simple examples of surfaces with boundary. 


Example I A closed n-dimensional ball B” in R" is an n-dimensional surface 
with boundary. Its boundary dB’ is the (n — 1)-dimensional sphere (see Figs. 12.8 
and 12.9a). The ball B”, which is often called in analogy with the two-dimensional 
case an n-dimensional disk, can be homeomorphically mapped to half of an 
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n-dimensional sphere whose boundary is the equatorial (n — 1)-dimensional sphere 
(Fig. 12.9b). 


Example 2 The closed cube T’ in R" can be homeomorphically mapped to the 
closed ball aB” along rays emanating from its center. Consequently T’, like B” is 
an n-dimensional surface with boundary, which in this case is formed by the faces 
of the cube (Fig. 12.10). We note that on the edges, which are the intersections of 
the faces, it is obvious that no mapping of the cube onto the ball can be regular (that 
is, smooth and of rank n). 


Example 3 If the Mébius band is obtained by gluing together two opposite sides of 
a closed rectangle, as described in Example 5 of Sect. 12.1, the result is obviously a 
surface with boundary in R?, and the boundary is homeomorphic to a circle (to be 
sure, the circle is not knotted in R3). 

Under the other possible gluing of these sides the result is a cylindrical surface 
whose boundary consists of two circles. This surface is homeomorphic to the usual 
planar annulus (see Fig. 12.3 and Example 5 of Sect. 12.1). Figures 12.11a, 12.11b, 
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12.12a, 12.12b, 12.13a, and 12.13b, which we will use below, show pairwise home- 
omorphic surfaces with boundary embedded in R* and R?. As one can see, the 
boundary of a surface may be disconnected, even when the surface itself is con- 
nected. 


12.3.2 Making the Orientations of a Surface and Its Boundary 


Consistent 
If an orienting orthoframe e,...,e, that induces Cartesian coordinates x i... x* 
is fixed in R*, the vectors e2,..., e, define an orientation on the boundary 0H k 


R‘! of 0H* = {x € R* | x! <0} which is regarded as the orientation of the half- 
space H* consistent with the orientation of the half-space H* given by the frame 
C1, ...,&%. 

In the case k = 1 where 0H* = R‘~! = R° is a point, a special convention needs 
to be made as to how to orient the point. By definition, the point is oriented by 
assigning a sign + or — to it. In the case 0H! = R®, we take (R°, +), or more 
briefly +R°. 

We now wish to determine what is meant in general by consistency of the orien- 
tation of a surface and its boundary. This is very important in carrying out compu- 
tations connected with surface integrals, which will be discussed below. 

We begin by verifying the following general proposition. 


Proposition 2 The boundary 0S of a smooth orientable surface S is itself a smooth 
orientable surface (although possibly not connected). 


Proof After we take account of Proposition | all that remains is to verify that 
dS is orientable. We shall show that if A(S) = {(H*, gj, Uj)} U {(R*, 9;, U;)} 
is an orienting atlas for a surface S with boundary, then the atlas A(dS) = 
{(R‘!, @; ly 47*—pk-1, 0U;)} of the boundary also consists of pairwise consistent 
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charts. To do this it obviously suffices to verify that if f = y(t) is a diffeomor- 
phism with positive Jacobian from an H*-neighborhood Uj, (to) of the point fo in 
dH* onto an H*-neighborhood U yk (to) of the point fp € OH k then the mapping 
lav) from the H*-neighborhood Us jx (to) = 0U yx (to) of to € H* onto the 
H*-neighborhood Dini (to) = aU yk (to) of 79 = W(to) € dH also has a positive 
Jacobian. 

We remark that at each point to = (0, fei phan i € 0H* the Jacobian J of the 
mapping y has the form 


ay! 
atl 0 0 ay? ay? 
ay? aye ay? 1 | ae ark 
__ | ar! ar? ark | ow . : : 
S(t) =], =. ae lec f 2 is 
: : tice : or! ; : 
: : : aw aw 
ar! ar ark 
since for t! = 0 we must also have f! = y!(0, t?, ..., t&) = 0 (boundary points map 
to boundary points under a diffeomorphism). It now remains only to remark that 
when t! <0 we must also have f = wile, t?,...,t*) <0 (since T= w(t) € H*), 
a1 
so that the value of 0, t?,...,t*) cannot be negative. By hypothesis J(to) > 0, 
1 
and since (0, t?,...,t*) > 0 it follows from the equality given above connect- 
ing the determinants that the Jacobian of the mapping w laU yk = (0, 77,...,¢*) is 


positive. 


We note that the case of a one-dimensional surface (k = 1) in Proposition 2 and 
Definition 3 below must be handled by a special convention in accordance with the 
convention adopted at the beginning of this subsection. 


Definition 3 If A(S) = {(H*,9g;,U;)} {(R*, 9), U;)} is an orienting atlas of 
standard local charts of the surface S with boundary 0S, then A(dS) = (Re, 
@\|977k=pRk-1, OU; )} is an orienting atlas for the boundary. The orientation of 0S that 
it defines is said to be the orientation consistent with the orientation of the surface. 


To finish our discussion of orientation of the boundary of an orientable surface, 
we make two useful remarks. 


Remark I In practice, as already noted above, an orientation of a surface embedded 
in R” is often defined by a frame of tangent vectors to the surface. For that reason, 
the verification of the consistency of the orientation of the surface and its boundary 
in this case can be carried out as follows. Take a k-dimensional plane TS, tangent to 
the smooth surface S at the point x9 € 0S. Since the local structure of S near xo is the 
same as the structure of the half-space H* near 0 € 0H*, directing the first vector 
of the orthoframe &,, &,..., &; € TSx, along the normal to 0S and in the direction 
exterior to the local projection of S on TS;,, we obtain a frame &,..., &; in the 
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(k — 1)-dimensional plane T0S,, tangent to 0S at x9, which defines an orientation 
of TdS,,, and hence also of 0S, consistent with orientation of the surface S defined 
by the given frame &),&5,..., & . 


Figures 12.9—12.12 show the process and the result of making the orientations of 
a surface and its boundary consistent using a simple example. 

We note that this scheme presumes that it is possible to translate a frame that 
defines the orientation of S to different points of the surface and its boundary, which, 
as examples show, may be disconnected. 


Remark 2 In the oriented space R* we consider the half-space H* = H* = {x € 
RE | x! <0} and HE = {x € R* | x! > 0} with the orientation induced from R*. The 
hyperplane 7 = {x € R* | x! = 0} is the common boundary of H. © and H. 1a It is 
easy to see that the orientations of the hyperplane I” consistent with the orientations 
of H* and H bi are opposite to each other. This also applies to the case k = 1, by 
convention. 

Similarly, if an oriented k-dimensional surface is cut by some (k — 1)-dimensional 
surface (for example, a sphere intersected by its equator), two opposite orientations 
arise on the intersection, induced by the parts of the original surface adjacent to it. 


This observation is often used in the theory of surface integrals. 

In addition, it can be used to determine the orientability of a piecewise-smooth 
surface. 

We begin by giving the definition of such a surface. 


Definition 4 (Inductive definition of a piecewise-smooth surface) We agree to call 
a point a zero-dimensional surface of any smoothness class. 

A piecewise smooth one-dimensional surface (piecewise smooth curve) is a curve 
in R” which breaks into smooth one-dimensional surfaces (curves) when a finite or 
countable number of zero-dimensional surfaces are removed from it. 

A surface S C R” of dimension k is piecewise smooth if a finite or countable 
number of piecewise smooth surfaces of dimension at most k — 1 can be removed 
from it in such a way that the remainder decomposes into smooth k-dimensional 
surfaces S$; (with boundary or without). 


Example 4 The boundary of a plane angle and the boundary of a square are 
piecewise-smooth curves. 

The boundary of a cube or the boundary of a right circular cone in R? are two- 
dimensional piecewise-smooth surfaces. 


Let us now return to the orientation of a piecewise-smooth surface. 

A point (zero-dimensional surface), as already pointed out, is by convention ori- 
ented by ascribing the sign + or — to it. In particular, the boundary of a closed 
interval [a, b] C R, which consists of the two points a and b is by convention con- 
sistent with the orientation of the closed interval from a to b if the orientation is 
(a, —), (b, +), or, in another notation, —a, +b. 
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Now let us consider a k-dimensional piecewise smooth surface S C R” (k > 0). 

We assume that the two smooth surfaces S;, and S;, in Definition 4 are ori- 
ented and abut each other along a smooth portion I” of a (k — 1)-dimensional sur- 
face (edge). Orientations then arise on J”, which is a boundary, consistent with the 
orientations of S;, and S;,. If these two orientations are opposite on every edge 
I’ C Si, N Siz, the original orientations of $;, and S;, are considered consistent. If 


S;, 1 S;, is empty or has dimension less than (k — 1), all orientations of S;, and S;, 
are consistent. 


Definition 5 A piecewise-smooth k-dimensional surface (k > 0) will be considered 
orientable if up to a finite or countable number of piecewise-smooth surfaces of 
dimension at most (k — 1) it is the union of smooth orientable surfaces S; any two 
of which have a mutually consistent orientation. 


Example 5 The surface of a three-dimensional cube, as one can easily verify, is an 
orientable piecewise-smooth surface. In general, all the piecewise-smooth surfaces 
exhibited in Example 4 are orientable. 


Example 6 The Mébius band can easily be represented as the union of two ori- 
entable smooth surfaces that abut along a piece of the boundary. But these surfaces 
cannot be oriented consistently. One can verify that the Mobius band is not an ori- 
entable surface, even from the point of view of Definition 5. 


12.3.3 Problems and Exercises 


1. a) Is it true that the boundary of a surface § C R” is the set S\S, where S is the 
closure of S in R”? 

b) Do the surfaces S, = {(x, y) € R* | 1 <x? + y* <2} and S) = {(x, y) |0< 
x* + y*} have a boundary? 

c) Give the boundary of the surfaces S} = {(x, y) € R? | 1 <x*+ y? <2} and 
S2={(, y)€R?|1<x?+y’}. 


2. Give an example of a nonorientable surface with an orientable boundary. 

3. a) Each face I* = {x € R* | |x'| < 1,i =1,...,k} is parallel to the correspond- 
ing (k — 1)-dimensional coordinate hyperplane in R*, so that one may consider the 
same frame and the same coordinate system in the face as in the hyperplane. On 
which faces is the resulting orientation consistent with the orientation of the cube 
T* induced by the orientation of R‘, and on which is it not consistent? Consider 
successively the cases k = 2, k =3, andk =n. 

b) The local chart (t!, 12) + (sint? cos??, sint? sint?, cost!) acts in a certain 
domain of the hemisphere S = {(x, y, z) € R3 | Fae y? +z7=1Az> 0}, and 
the local chart t + (cost, sint,0) acts in a certain domain of the boundary 0S of 
this hemisphere. Determine whether these charts give a consistent orientation of the 
surface S and its boundary 0S. 
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c) Construct the field of frames on the hemisphere S$ and its boundary 0S in- 
duced by the local charts shown in b). 

d) On the boundary 0S of the hemisphere S exhibit a frame that defines the 
orientation of the boundary consistent with the orientation of the hemisphere given 
inc). 

e) Define the orientation of the hemisphere S$ obtained in c) using a normal 
vector to SC R?. 


4. a) Verify that the Mobius band is not an orientable surface even from the point 
of view of Definition 5. 

b) Show that if S is a smooth surface in IR”, determining its orientability as a 
smooth surface and as a piecewise-smooth surface are equivalent processes. 


5. a) We shall say that a set S C R” is a k-dimensional surface with boundary if 
for each point x € S there exists a neighborhood U(x) € R” and a diffeomorphism 
w : U(x) > I” of this neighborhood onto the standard cube J” C R” under which 
w(SM U(x)) coincides either with the cube [* = {t € 1” | kt! =... = 1" =0} or 
with a portion of it J‘ {t € R” | t* < 0} that is a k-dimensional open interval with 
one of its faces attached. 

Based on what was said in Sect. 12.1 in the discussion of the concept of a surface, 
show that this definition of a surface with boundary is equivalent to Definition 1. 

b) Is it true that if f ¢ C0(H*,R), where H* = {x € Ré | x! < 0}, then for 
every point x € 0H* one can find a neighborhood of it U(x) in R* and a function 
F € COU (x), R) such that Fl yequ yy = flatnua? 

c) If the definition given in part a) is used to describe a smooth surface with 
boundary, that is, we regard yw as a smooth mapping of maximal rank, will this 
definition of a smooth surface with boundary be the same as the one adopted in 
Sect. 12.3? 


12.4 The Area of a Surface in Euclidean Space 


We now turn to the problem of defining the area of a k-dimensional piecewise- 
smooth surface embedded in the Euclidean space R”, n > k. 

We begin by recalling that if &,,..., &, are k vectors in Euclidean space R*, then 
the volume V(&,,..., &;) of the parallelepiped spanned by these vectors as edges 
can be computed as the determinant 


V(E\,---,€,) = det(é/) (12.6) 


of the matrix J = (& ) whose rows are formed by the coordinates of these vectors 
in some orthonormal basis e),..., ex of R*. We note, however, that in actual fact 
formula (12.6) gives the so-called oriented volume of the parallelepiped rather than 
simply the volume. If V # 0, the value of V given by (12.6) is positive or negative 
according as the frames e1,...,e, and &,,...,&, belong to the same or opposite 
orientation classes of R*. 
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Fig. 12.14 


We now remark that the product JJ* of the matrix J and its transpose J* has 
elements that are none other than the matrix G = (g;;) of pairwise inner products 
8ij = (§;,€ ;) of these vectors, that is, the Gram matrix® of the system of vectors 
&,,...,&;,. Thus 


det G = det(J J*) = det J det J* = (det J)’, (12.7) 


and hence the nonnegative value of the volume V(&,,..., &,) can be obtained as 


V(E1,.--, &) = y/ det((&;, €;)). (12.8) 


This last formula is convenient in that it is essentially coordinate-free, containing 
only a set of geometric quantities that characterize the parallelepiped under consid- 
eration. In particular, if these same vectors &,,..., &, are regarded as embedded in 
n-dimensional Euclidean space R” (n > k), formula (12.8) for the k-dimensional 
volume (or k-dimensional surface area) of the parallelepiped they span remains un- 


changed. 

Now let r: D—> S C R"” bea k-dimensional smooth surface S in the Euclidean 
space R” defined in parametric form r = r(t!, tk ), that is, as a smooth vector- 
valued function r(t) = (x!,..., x”)(t) defined in the domain D C R*. Let ey, ..., ex 
be the orthonormal basis in R* that generates the coordinate system (t!,..., i*, 
After fixing a point fo = ee te) € D, we take the positive numbers h!,..., h* 
to be so small that the parallelepiped 7 spanned by the vectors h'e; € TD, i = 
1,...,k, attached at the point fg is contained in D. 


Under the mapping D — S a figure Js; on the surface S$, which we may provi- 
sionally call a curvilinear parallelepiped, corresponds to the parallelepiped J (see 
Fig. 12.14, which corresponds to the case k = 2, n = 3). Since 


1 A oe a at ot k 1 if ae k 
Pijestity. ge ly’ oe SH Riwsh San eet 


or . . 
= apt toh! + o(h'), 


8See the footnote on p. 497. 
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a displacement in R” from r(tg) that can be replaced, up to o(h'), by the partial dif- 
ferential Fr (toh! =:fr;h' as h' > 0 corresponds to displacement from fg by hie. 
Thus, for small values of h', i =1,...,k, the curvilinear parallelepiped Js differs 
only slightly from the parallelepiped spanned by the vectors h!ir},..., h'ity, tangent 
to the surface S at r(fo). Assuming on that basis that the volume AV of the curvilin- 
ear parallelepiped Js; must also be close to the volume of the standard parallelepiped 
just exhibited, we find the approximate formula 


AV © ,/det(g;;)(to) At! -...- Ar*, (12.9) 


where we have set gj; (fo) = (fi, %j) (to) and At! =h', i, eo Peers 

If we now tile the entire space R“ containing the parameter domain D with k- 
dimensional parallelepipeds of small diameter d, take the ones that are contained 
in D, compute an approximate value of the k-dimensional volume of their images 
using formula (12.9), and then sum the resulting values, we arrive at the quantity 


> ,/det(gij) (ty) At! -...- Atk, 


which can be regarded as an approximation to the k-dimensional volume or area of 
the surface S under consideration, and this approximate value should become more 
precise as d — 0. Thus we adopt the following definition. 


Definition 1 The area (or k-dimensional volume) of a smooth k-dimensional sur- 
face S given parametrically by D 3 t > r(t) € S and embedded in the Euclidean 
space R” is the quantity 


V;.(S) = [eet ti. i) art art (12.10) 


Let us see how formula (12.10) looks in the cases that we already know about. 

For k = 1 the domain D C R! is an interval with certain endpoints a and b 
(a <b) on the line R!, and S is a curve in R” in this case. Thus for k = 1 formula 
(12.10) becomes the formula 


b b ra 7) 
visy= f ln|ar= | Ve) feet (4")() dt 


for computing the length of a curve. 

If k =n, then S is an n-dimensional domain in R” diffeomorphic to D. In this 
case the Jacobian matrix J = x'(t) of the mapping D 5 (oo) =tert)= 
(xl... x") eS isa square matrix. Now using relation (12.7) and the formula 
for change of variable in a multiple integral, one can write 


vats) = | VarGiar = | Jacts'(|ar= f av =Vis) 
D D Ss 
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That is, as one should have expected, we have arrived at the volume of the domain 
Sin R”. 

We note that for k = 2, n = 3, that is, when S is a two-dimensional surface in R3, 
one often replaces the standard notation g;; = (r;,1;) by the following: o := V2(S), 
E:= g11 = (t%1,11), F := g12 = g21 = (¥1, 82), G := g22 = (2, r2); and one writes 
u, v respectively instead of t!, t?. In this notation formula (12.10) assumes the form 


o= ff VEG — F2 dudv. 
D 


In particular, if uw = x, v = y, and the surface S$ is the graph of a smooth real- 
valued function z = f(x, y) defined in a domain D C R?, then, as one can easily 
compute, 


o= ff 1+ (6) +(K) axay. 


We now return once again to Definition 1 and make a number of remarks that 
will be useful later. 


Remark 1 Definition 1 makes sense only when the integral on the right-hand side 
of (12.10) exists. It demonstrably exists, for example, if D is a Jordan-measurable 
domain and r € C“)(D, R"”). 


Remark 2 If the surface S$ in Definition | is partitioned into a finite number of sur- 
faces S,,..., Sm with piecewise smooth boundaries, the same kind of partition of 
the domain D into domains D),..., Dj», corresponding to these surfaces will corre- 
spond to this partition. If the surface S had area in the sense of Eq. (12.10), then the 


quantities 
Visa) =f deri Var 
Da 


are defined for each value of a= 1,...,m. 
By the additivity of the integral, it follows that 


Vi(S) =) > Vi(Sa)- 


We have thus established that the area of a k-dimensional surface is additive in 
the same sense as the ordinary multiple integral. 


Remark 3 This last remark allows us to exhaust the domain D when necessary, and 
thereby to extend the meaning of the formula (12.10), in which the integral may 
now be interpreted as an improper integral. 


Remark 4 More importantly, the additivity of area can be used to define the area of 
an arbitrary smooth or even piecewise smooth surface (not necessarily given by a 
single chart). 
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Definition 2 Let S be an arbitrary piecewise smooth k-dimensional surface in R”. 
If, after a finite or countable number of piecewise smooth surfaces of dimension at 
most k — | are removed, it breaks up into a finite or countable number of smooth 
parametrized surfaces S),..., Sm,..., we set 


Ve(S) = D7 Vi (Sa). 


The additivity of the multiple integral makes it possible to verify that the quantity 
V;.(S) so defined is independent of the way in which the surface S' is partitioned into 
smooth pieces S1,..., Sm, ..., each of which is contained in the range of some local 
chart of the surface S. 

We further remark that it follows easily from the definitions of smooth and piece- 
wise smooth surfaces that the partition of S into parametrized pieces, as described 
in Definition 2, is always possible, and can even be done while observing the natural 
additional requirement that the partition be locally finite. The latter means that any 
compact set K C S can intersect only a finite number of the surfaces S],..., Sim,.... 
This can be expressed more vividly in another way: every point of S must have a 
neighborhood that intersects at most a finite number of the sets $1,..., Sm,..-- 


Remark 5 The basic formula (12.10) contains a system of curvilinear coordinates 
t',...,¢*. For that reason, it is natural to verify that the quantity V;(S) defined by 
(12.10) (and thereby also the quantity V;(S) from Definition 2) is invariant under a 
diffeomorphic transition D> aa yt*) rt t=(t!,...,t*) € D to new curvilin- 
ear coordinates f!,...,* varying in the domain DcR*. 


Proof For the verification it suffices to remark that the matrices 


dr or ~ nw or or 


at corresponding points of the domains D and D are connected by the relation G= 
J*GJ, where J = (45) is the Jacobian matrix of the mapping D>7tHtED 
and J* is the transpose of the matrix J. Thus, det G(f) = det G(t)(det J)? (A), from 
which it follows that 


VdetG(t) dt = | ,/detG(t(7))|J(7)| dF= |. det G7) di. 
if et G(t) dt [ et G(t())|J(7)| dr i. et G(T) dt 


Thus, we have given a definition of the k-dimensional volume or area of a k- 
dimensional piecewise-smooth surface that is independent of the choice of coordi- 
nate system. 


Remark 6 We precede the remark with a definition. 
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Definition 3 A set E embedded in a k-dimensional piecewise-smooth surface S is 
a set of k-dimensional measure zero or has area zero in the Lebesgue sense if for 
every € > 0 it can be covered by a finite or countable system Sj,...,Sm,... of 
(possibly intersecting) surfaces Sy C S such that 7, Ve(Sa) <6. 


As one can see, this is a verbatim repetition of the definition of a set of measure 
zero in R*. 

It is easy to see that in the parameter domain D of any local chart g: D—> S of 
a piecewise-smooth surface S the set g7! (E)cC DC IR¥ of k-dimensional measure 
zero corresponds to such a set E. One can even verify that this is the characteristic 
property of sets E C S of measure zero. 

In the practical computation of areas and the surface integrals introduced below, 
it is useful to keep in mind that if a piecewise-smooth surface S has been obtained 
from a piecewise-smooth surface S by removing a set E of measure zero from S, 
then the areas of S and S are the same. 

The usefulness of this remark lies in the fact that it is often easy to remove such 
a set of measure zero from a piecewise-smooth surface in such a way that the result 
is a smooth surface S defined by a single chart. But then the area of S and hence the 
area of S also can be computed directly by formula (12.10). 

Let us consider some examples. 


Example 1 The mapping ]0,27[ 5 t +> (Roost, Rsint) € IR? is a chart for the 
arc S of the circle x* + y* = R? obtained by removing the single point E = (R, 0) 
from that circle. Since E is a set of measure zero on S, we can write 


20 
V,(S) = Vi (S) = V R2 sin? t + R2cos2t dt =27R. 
0 


Example 2 In Example 4 of Sect. 12.1 we exhibited the following parametric rep- 
resentation of the two-dimensional torus S in R?: 


r¢,w)= ((b +acosw)cos@, (b+ acosy) sing, asin y). 


In the domain D = {(g, ¥) | 0 < g < 22,0 < w < 27} the mapping (g, fy) b> 
r(g, w) is a diffeomorphism. The image S of the domain D under this diffeomor- 
phism differs from the torus by the set E consisting of the coordinate line g = 27 
and the line y% = 27. The set E thus consists of one parallel of latitude and one 
meridian of longitude of the torus, and, as one can easily see, has measure zero. 
Hence the area of the torus can be found by formula (12.10) starting from this para- 
metric representation, considered within the domain D. 
Let us carry out the necessary computations: 


ips (-( +acosw) sing, (b+ acosy)cosq, 0), 
ry = (—asiny) cos g, —asiny sing, acos yp), 


g11 = (ty, ty) =(b+acosyp)’, 
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812 = 821 = (fy, Ty) =9, 
gn = (ty. ty) =a’, 


811 812 


2 2 
=a“(b+acos 
821 822 ( ve 


detG = 


Consequently, 


2n 20 
V2(S) = va) = | a | a(b +acos) dw = 4x7 ab. 
0 0 


In conclusion we note that the method indicated in Definition 2 can now be used 
to compute the areas of piecewise-smooth curves and surfaces. 


12.4.1 Problems and Exercises 


1. a) Let P and P be two hyperplanes in the Euclidean space R”, D a subdo- 
main of P, and D the orthogonal projection of D on the hyperplane P. Show 
that the (n — 1)-dimensional areas of D and D are connected by the relation 
o(D) = 0(D) cosa, where a is the angle between the hyperplanes P and P. 

b) Taking account of the result of a), give the geometric meaning of the formula 


do = fi + (ff)? + (ff)? dx dy for the element of area of the graph of a smooth 


function z = f (x, y) in three-dimensional Euclidean space. 

c) Show that if the surface S in Euclidean space R? is defined as a smooth 
vector-valued function r = r(u, v) defined in a domain D C R?, then the area of 
the surface S can be found by the formula 


o(S)= [ [hte ', || du dv, 


where [r/,, r’,] is the vector product of ar and ar 
d) Verify that if the surface S C R? is defined by the equation F(x, y, z) =O and 
the domain U of the surface S projects orthogonally in a one-to-one manner onto 


the domain D of the x y-plane, we have the formula 


= FA 
o(U)= iF 
2. Find the area of the spherical rectangle formed by two parallels of latitude and 
two meridians of longitude of the sphere S C R?. 
3. a) Let (r,y,h) be cylindrical coordinates in R?. A smooth curve lying in the 


plane y = g and defined there by the equation r = r(s), where s is the arc length 
parameter, is revolved about the h-axis. Show that the area of the surface obtained 
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by revolving the piece of this curve corresponding to the closed interval [51,52] of 
variation of the parameter s can be found by the formula 


52 
o=2n [ r(s) ds. 
S| 


b) The graph of a smooth nonnegative function y = f(x) defined on a closed 
interval [a, b] C Rx is revolved about the x-axis, then about the y-axis. In each of 
these cases, write the formula for the area of the corresponding surface of revolution 
as an integral over the closed interval [a, b]. 


4. a) The center of a ball of radius 1 slides along a smooth closed plane curve of 
length L. Show that the area of the surface of the tubular body thereby formed is 
2n-1-L. 

b) Based on the result of part a), find the area of the two-dimensional torus 
obtained by revolving a circle of radius a about an axis lying in the plane of the 
circle and lying at distance b > a from its center. 


5. Describe the helical surface defined in Cartesian coordinates (x, y, z) in R? by 
the equation 


z 
y=xtan, =0, Iz) < x—h, 


and find the area of the portion of it for which r* < x* + y* < R?. 


6. a) Show that the area (2,_; of the unit sphere in R” is a , Where "(a) = 


he e-*x%—! dx. (In particular, if n is even, then r= (A) while if n is odd, 
MQ) = ave) 
b) By verifying that the volume V,,(r) of the ball of radius r in R” is 


show that on pat = 2,41: 


c) Find the limit as n > oo of the ratio of the area of the hemisphere {x € R” | 
|x| = 1 Ax” > 0} to the area of its orthogonal projection on the plane x” = 0. 

d) Show that as n — oo, the majority of the volume of the n-dimensional ball is 
concentrated in an arbitrarily small neighborhood of the boundary sphere, and the 
majority of the area of the sphere is concentrated in an arbitrarily small neighbor- 
hood of its equator. 

e) Show that the following beautiful corollary on concentration phenomena fol- 
lows from the observation made in d). 

A regular function that is continuous on a sphere of large dimension is nearly 
constant on it (recall pressure in thermodynamics). 

Specifically, let us consider, for example, functions satisfying a Lipschitz condi- 
tion with a fixed constant. Then for any ¢ > 0 and 6 > 0 there exists N such that 
for n > N and any function f : S” > R there exists a value c with the following 
properties: the area of the set on which the value of f differs from c by more than ¢ 
is at most 6 times the area of the whole sphere. 


(ym)"_n 
ree)” 
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7. a) Let x1,...,x, be a system of vectors in Euclidean space R”, n > k. Show that 
the Gram determinant of this system can be represented as 


det((x;, x;)) = > Pe gs 
1 <i, <-+-<ig<n 


where 


b) Explain the geometric meaning of the quantities P;,...;, from a) and state the 
result of a) as the Pythagorean theorem for measures of arbitrary dimension k, 
1<k<n. 

c) Now explain the formula 


ax! axl 


are 

o=| Yo det? Jo: o,f dels. dr! 
2 1 Siy <+-+<ig<n axtk = axtk 
ar! ark 


for the area of a k-dimensional surface given in the parametric form x = 
x(t, ...;#9,tEeDcR*. 


8. a) Verify that the quantity V;(S) in Definition 2 really is independent of the 


method of partitioning the surface S into smooth pieces S},..., Sn,.... 
b) Show that a piecewise-smooth surface S admits the locally finite partition 
into pieces S},..., Sm,... described in Definition 2. 


c) Show that a set of measure 0 can always be removed from a piecewise-smooth 
surface S so as to leave a smooth surface S = S\ E that can be described by a single 
standard local chart gp: ] > S. 


9. The length of a curve, like the high-school definition of the circumference of a 
circle, is often defined as the limit of the lengths of suitably inscribed broken lines. 
The limit is taken as the length of the links in the inscribed broken lines tend to 
zero. The following simple example, due to H. Schwarz, shows that the analogous 
procedure in an attempt to define the area of even a very simple smooth surface in 
terms of the areas of polyhedral surfaces “inscribed” in it, may lead to an absurdity. 

In a cylinder of radius R and height H we inscribe a polyhedron as follows. 
Cut the cylinder into m equal cylinders each of height H/m by means of horizontal 
planes. Break each of the m+ 1 circles of intersection (including the upper and lower 
bases of the original cylinder) into n equal parts so that the points of division on each 
circle lie beneath the midpoints of the points of division of the circle immediately 
above. We now take a pair of division points of each circle and the point lying 
directly above or below the midpoint of the arc whose endpoints they are. 


12.5 Elementary Facts About Differential Forms 195 


These three points form a triangle, and the set of all such triangles forms a poly- 
hedral surface inscribed in the original cylindrical surface (the lateral surface of a 
right circular cylinder). In shape this polyhedron resembles the calf of a boot that 
has been crumpled like an accordion. For that reason it is often called the Schwarz 
boot. 


a) Show that if m and n are made to tend to infinity in such a way that the 
ratio n*/m tends to zero, then the area of the polyhedral surface just constructed 
will increase without bound, even though the dimensions of each of its faces (each 
triangle) tend to zero. 

b) If n and m tend to infinity in such a way that the ratio m/n? tends to some 
finite limit p, the area of the polyhedral surfaces will tend to a finite limit, which 
may be larger than, smaller than, or (when p = 0) equal to the area of the original 
cylindrical surface. 

c) Compare the method of introducing the area of a smooth surface described 
here with what was just done above, and explain why the results are the same in the 
one-dimensional case, but in general not in the two-dimensional case. What are the 
conditions on the sequence of inscribed polyhedral surfaces that guarantee that the 
two results will be the same? 


10. The isoperimetric inequality. Let V(E) denote the volume of a set E C R”, and 
A+ B the (vector) sum of the sets A, B C R”. (The sum in the sense of Minkowski 
is meant. See Problem 4 in Sect. 11.2.) 
Let B be a ball of radius h. Then A+ B =: Aj is the h-neighborhood of the set A. 
The quantity 


V(An)-— V(A 
lim V(An)— VA) =: 4.(0A) 
h->0 h 
is called the Minkowski outer area of the boundary 0A of A. 


a) Show that if 0A is a smooth or sufficiently regular surface, then 4(0A) 
equals the usual area of the surface 0A. 

b) Using the Brunn—Minkowski inequality (Problem 4 of Sect. 11.2), obtain now 
the classical isoperimetric inequality in R": 


1 n—1 
4(0A) >nveVm (A) =: w(Sa); 


here V is the volume of the unit ball in R”, and y(S,) the area of the ((n — 1)- 
dimensional) surface of the ball having the same volume as A. 

The isoperimetric inequality means that a solid A C R” has boundary area 
j44(0A) not less than that of a ball of the same volume. 


12.5 Elementary Facts About Differential Forms 


We now give an elementary description of the convenient mathematical machinery 
known as differential forms, paying particular attention here to its algorithmic poten- 
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tial rather than the details of the theoretical constructions, which will be discussed 
in Chap. 15. 


12.5.1 Differential Forms: Definition and Examples 


Having studied algebra, the reader is well acquainted with the concept of a linear 
form, and we have already made extensive use of that concept in constructing the 
differential calculus. In that process we encountered mostly symmetric forms. In the 
present subsection we will be discussing skew-symmetric (anti-symmetric) forms. 

We recall that a form L : X* —> Y of degree or order k defined on ordered sets 
&,,...,&; of vectors of a vector space X and assuming values in a vector space Y 
is skew-symmetric or anti-symmetric if the value of the form changes sign when any 
pair of its arguments are interchanged, that is, 


LG pcan Shas iaine SOE a Cryostat ee 


In particular, if §; = € ; then the value of the form will be zero, regardless of the 
other vectors. 


Example I The vector (cross) product [&,,&>] of two vectors in IR? is a skew- 
symmetric bilinear form with values in R?. 


Example 2 The oriented volume V(&,,..., &;) of the parallelepiped spanned by the 
vectors &,,...,&, of R*, defined by Eq. (12.6) of Sect. 12.4, is a skew-symmetric 
real-valued k-form on R¥. 


For the time being we shall be interested only in real-valued k-forms (the case 
Y =R), even though everything that will be discussed below is applicable to the 
more general situation, for example, when Y is the field C of complex numbers. 

A linear combination of skew-symmetric forms of the same degree is in turn a 
skew-symmetric form, that is, the skew-symmetric forms of a given degree consti- 
tute a vector space. 

In addition, in algebra one introduces the exterior product \ of skew-symmetric 
forms, which assigns to an ordered pair A”, BY of such forms (of degrees p and q 
respectively) a skew-symmetric form A? A B4 of degree p + q. This operation is 


associative: (A? A Bf) AC’ = AP A (BL AC"), 
distributive: (A? + B?) AC4 =A? ACL 4 BP ACY, 
skew-commutative: A? A BY = (—1)?7 B14 A AP. 


In particular, in the case of 1-forms A and B, we have anticommutativity AA B = 
—B AA, for the operations, like the anticommutativity of the vector product shown 
in Example |. The exterior product of forms is in fact a generalization of the vector 
product. 
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Without going into the details of the definition of the exterior product, we take 
as known for the time being the properties of this operation just listed and observe 
that in the case of the exterior product of 1-forms L;,..., Lx € £(R”, R) the result 
Li A---A Lx is a k-form that assumes the value 


L1(&\) +++ Le(& 1) 
Ly A+: ALE. 8 =]: Ty > |=det(L;(é;)) (12.11) 
Li(E) +++ Le&) 
on the set of vectors &),..., &;. 
If relation (12.11) is taken as the definition of the left-hand side, it follows from 
properties of determinants that in the case of linear forms A, B, and C, we do indeed 


have AA B=—BAAand (A+ B)AC=AAC+BAC. 
Let us now consider some examples that will be useful below. 


Example 3 Let 2! € £(R",R),i=1,...,n, be the projections. More precisely, the 
linear function zr‘ : R” —> R is such that on each vector € = (é!,...,€”) € R” it 
assumes the value /(&) = &! of the projection of that vector on the corresponding 
coordinate axis. Then, in accordance with formula (12.11) we obtain 


e) ae. oF 
Tl Ass ARE ak p=|s My =|, (12.12) 
gE} sad EY 
Example 4 The Cartesian coordinates of the vector product [&,, 5] of the vectors 


é,= (é}, EB. &?) and &, = (&}, &, &3) in the Euclidean space R?, as is known, are 
defined by the equality 


bo tl=( 


Thus, in accordance with the result of Example 3 we can write 


gi gf 
“Ea Sp 


gE} 
‘8 & 


gf & 
§  & 


me! ([€,&)1) =2? Am? (&1, &)), 
m*([€),€]) =2° Am'(&1,§), 
1 *([€),€51) =z! Am (& 1,8). 


Example 5 Let f : D — R bea function that is defined in a domain D C R” and dif- 
ferentiable at x9 € D. As is known, the differential df (xo) of the function at a point 
is a linear function defined on displacement vectors & from that point. More pre- 
cisely, on vectors of the tangent space TD,, to D (or R”) at the point under consid- 
eration. We recall that if x!,...,x” are the coordinates in R” and gé=( B cae &"), 
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then 


af 


ox” 


0 
df (x0) (§) = oF (wo)8! +++++ —— (x0)&" = Dg f (x0). 


In particular dx! (€) = &', or, more formally, dx!(xo)(&) = &!. If fi,..., fe are 
real-valued functions defined in G and differentiable at the point x9 € G, then in 
accordance with (12.11) we obtain 


dfi(§)) -» df, (&1) 
df; A---Adf;,(1,---.8) = ee (12.13) 
afi(&,) «+ dp (&,) 


at the point xo for the set &,,..., &, of vectors in the space TG,,; and, in particular, 


ef a gtk 
dx!t A.--Adx'k(B,,...,8&)=| 2 7. 2 |. (12.14) 
gi ae git 


In this way skew-symmetric forms of degree k defined on the space TD, © 
TRY, = IR” have been obtained from the linear forms df}, ..., df; defined on this 
space. 


Example 6 If f € C“(D,R), where D is a domain in R”, then the differential 
df (x) of the functions f is defined at any point x € D, and this differential, as 
has been stated, is a linear function df (x) : TD, > TR.) © R on the tangent 
space TD, to D at x. In general the form df (x) = f’(x) varies in passage from one 
point to another in D. Thus a smooth scalar-valued function f : D > R generates a 
linear form d f (x) at each point, or, as we say, generates a field of linear forms in D, 
defined on the corresponding tangent spaces TD,. 


Definition 1 We shall say that a real-valued differential p-form is defined in the 
domain D C R” if a skew-symmetric form w(x) : (TD,)? — R is defined at each 
point x € D. 


The number p is usually called the degree or order of w. In this connection the 
p-form a is often denoted w?. 

Thus, the field of the differential df of a smooth function f : D — R considered 
in Example 6 is a differential 1-form in D, and w = dx!! A --- A dx! is the simplest 
example of a differential form of degree p. 


Example 7 Suppose a vector field D C R” is defined, that is, a vector F(x) is at- 
tached to each point x € D. When there is a Euclidean structure in R” this vector 
field generates the following differential 1-form Op in D. 
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If & is a vector attached to x € D, that is, & € TD,., we set 
op(x)(€) = (F(x), &). 


It follows from properties of the inner product that Or (x) = (F(x), -) is indeed a 
linear form at each point x € D. 

Such differential forms arise very frequently. For example, if F is a continuous 
force field in D and & an infinitesimal displacement vector from the point x € D, 
the element of work corresponding to this displacement, as is known from physics, 
is defined precisely by the quantity (F(x), &). 

Thus a force field F in a domain D of the Euclidean space R” naturally generates 
a differential 1-form On in D, which it is natural to call the work form of the field F 
in this case. 

We remark that in Euclidean space the differential df of a smooth function f : 
D — R in the domain D C R” can also be regarded as the 1-form generated by a 
vector field, in this case the field F = grad f. In fact, by definition grad f is such 
that df (x) (&) = (grad f(x), &) for every vector € € TD,. 


Example 8 A vector field V defined in a domain D of the Euclidean space R” can 
also be regarded as a differential form oy | of degree n — 1. If at a point x € D we 
take the vector field V(x) and n — 1 additional vectors &;,...,&,, € TD, attached to 
the point x, then the oriented volume of the parallelepiped spanned by the vectors 
V(x), &;,...,&, 1, which is the determinant of the matrix whose rows are the co- 
ordinates of these vectors, will obviously be a skew-symmetric (n — 1)-form with 
respect to the variables &),...,&,_1. 

For n = 3 the form wy is the usual scalar triple product (V(x), &;, &) of vectors, 
one of which V(x) is given, resulting in a skew-symmetric 2-form wy = (V,-,-). 

For example, if a steady flow of a fluid is taking place in the domain D and 
V(x) is the velocity vector at the point x € D, the quantity (V(x), &,, 5) is the 
element of volume of the fluid passing through the (parallelogram) area spanned 
by the small vectors €; € TD, and &, € TD, in unit time. By choosing different 
vectors &, and &5, we shall obtain areas (parallelograms) of different configuration, 
differently situated in space, all having one vertex at x. For each such area there 
will be, in general, a different value (V(x), &,,&>) of the form wy (x). As has been 
stated, this value shows how much fluid has flowed through the surface in unit time, 
that is, it characterizes the flux across the chosen element of area. For that reason 
we often call the form wy (and indeed its multidimensional analogue oy") the flux 
form of the vector field V in D. 


12.5.2 Coordinate Expression of a Differential Form 


Let us now investigate the coordinate expression of skew-symmetric algebraic and 
differential forms and show, in particular, that every differential k-form is in a certain 
sense a linear combination of standard differential forms of the form (12.14). 
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To abbreviate the notation, we shall assume summation over the range of allow- 
able values for indices that occur as both superscripts and subscripts (as we did 
earlier in similar situations). 

Let L be a k-linear form in R”. If a basis ej,...,e, is fixed in R”, then each 
vector & € R” gets a coordinate representation € = &'e; in that basis, and the form L 
acquires the coordinate expression 


L(E1,..-,€4) = L(Ei'ei, «5 & ei) = LW, «CR EL EE (12.15) 


The numbers qj,,.._.;, = L(ei,,..., €;,) characterize the form L completely if the 
basis in which they have been obtained is known. These numbers are obviously 
symmetric or skew-symmetric with respect to their indices if and only if the form L 
possesses the corresponding type of symmetry. 

In the case of a skew-symmetric form L the coordinate representation can be 
transformed slightly. To make the direction of that transformation clear and natural, 
let us consider the special case of (12.15) that occurs when L is a skew-symmetric 
2-form in R?. Then for the vectors €; = et! ej, and &, = EPei,, where ij, i2 = 1, 2, 3, 
we obtain 


L(E1, &2) = L (Eye, 83°e) = Lei, €)6)'83 = 
= L(e1, e1)é 1) + Lei, ene 1s + L(ei, e3)E LES + 
+ L(e2, e1)EpE} + L(e2, er)EL EF + L(e2, 38, &} + 
+ L(@3, €1)€;&) + L(e3, e2)E PEs + L(es, e387) = 
= L(e1, e2)(§ 13 — §7§3) + Lies, e3) (E783 — §7 7) + 


1 12 
5 8) 
al 19 
§  & 


’ 


+ L(eo,e3)(&8 — 8 8)= D> Leen, ein) 


1<ij <i2 <3 


where the summation extends over all combinations of indices i; and iz that satisfy 
the inequalities written under the summation sign. 

Similarly in the general case we can also obtain the following representation for 
a skew-symmetric form L: 


Fae 
EGiisB= So LlGysecy)| 2 “ey bls (12.16) 
1<ij <-+-<ig<n ae <a. gt 


Then, in accordance with formula (12.12) this last equality can be rewritten as 


LE ince = YS - LGigcravity a Ao An” CpnrcB)- 


1Siy <+++<igSin 
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Thus, any skew-symmetric form L can be represented as a linear combination 


L= > jy nig! A+ Are (12.17) 


1 Siy <+++ <i Sin 


of the k-forms z!! A --- A 2‘, which are the exterior product formed from the 
elementary 1-forms zi. ..., 7” inR". 

Now suppose that a differential k-form @ is defined in some domain D C R” 
along with a curvilinear coordinate system x!,..., x”. At each point x € D we fix 
the basis e;(x),...,€n(x) of the space TD,, formed from the unit vectors along the 
coordinate axes. (For example, if x! ...,x" are Cartesian coordinates in R”, then 
€1(x),...,€,(x) is simply the frame e;,...,e, in R” translated parallel to itself 
from the origin to x.) Then at each point x € D we find by formulas (12.14) and 
(12.16) that 


w(x)(§1,.--,€) = 
= > (ej, (x), ..., ei (x) dx A+ A dx" (E1,..., &) 


<i] <-+-<ig<n 
or 


(x) = = Aj, ig (X) Ax! A+ A dx'k, (12.18) 


1<i, <-+-<ig<n 


Thus, every differential k-form is a combination of the elementary k-forms dx!! A 
--» A dx'* formed from the differentials of the coordinates. As a matter of fact, that 
is the reason for the term “differential form”. 

The coefficients aj,...;, (x) of the linear combination (12.18) generally depend on 
the point x, that is, they are functions defined in the domain in which the form w* is 
given. 

In particular, we have long known the expansion of the differential 


us (x)dxl+...+ OT eae (12.19) 
x Ox” 


df (x)= aT 


and, as can be seen from the equalities 
(F, &) = (Fe; (x), €?e,,(x)) = 


= (e;, (x), ei (x))F" (WE? = iin (x) FU (X)E? = 
= ijin (x) F" (x) dx'2(&), 


the expansion 


op(x) = (F(x), -) = (ii (x) F! (x) dx! = a; (x) dx! (12.20) 


202 12 Surfaces and Differential Forms in R” 


also holds. In Cartesian coordinates this expansion looks especially simple: 
wp(x) = = (F(x), - =D Fi (x) dx!. (12.21) 


Next, the following equality holds in R?: 


Vix) V2) V3(x) 
wy (x)(E 1,6) =| § & gp [= 


hog 
EP ei Reclei et sins (EL St 
ZG) + V2(x) + V3(x) 
eg eof" el 


from which it follows that 
wy (x) = V1 (x) dx? A dx? + V2 (x) dx? A dx! + V3(x) dx! Adx?. (12.22) 


Similarly, expanding the determinant of order n for the form wy a by minors 
along the first row, we obtain the expansion 


oy = ODI Vix) dxl A+ A dx! A+ A dx", (12.23) 


where the sign — stands over the differential that is to be omitted in the indicated 
term. 


12.5.3. The Exterior Differential of a Form 


All that has been said up to now about differential forms essentially involved each 
individual point x of the domain of definition of the form and had a purely algebraic 
character. The operation of (exterior) differentiation of such forms is specific to 
analysis. 

Let us agree from now on to define the 0-forms in a domain to be functions 
f : D— R defined in that domain. 


Definition 2 The (exterior) differential of a 0-form f, when f is a differentiable 
function, is the usual differential df of that function. 


If a differential p-form (p > 1) defined in a domain D C R” 


C(x) = dj,.i, (x) dx"! A+++ A dx'? 
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has differentiable coefficients qj,...; e (x), then its (exterior) differential is the form 
daw(x) = daj,...i, (x) A dx A... Adx!?, 


Using the expansion (12.19) for the differential of a function, and relying on the 
distributivity of the exterior product of 1-forms, which follows from relation (12.11), 
we conclude that 
dai, i ip 

ax! 


= Qiiy---i, (x) dx! Adx!l A+. A dx'?, 


dw(x) = (x) dx! Adx!! A---Adx!i? = 


that is, the (exterior) differential of a p-form (p > 0) is always a form of degree 
pt+l. 

We note that Definition | given above for a differential p-form in a domain 
D CR", as one can now understand, is too general, since it does not in any way 
connect the forms w(x) corresponding to different points of the domain D. In ac- 
tuality, the only forms used in analysis are those whose coordinates qj,...;,(%) in 
a coordinate representation are sufficiently regular (most often infinitely differen- 
tiable) functions in the domain D. The order of smoothness of the form w in the 
domain D C R” is customarily characterized by the smallest order of smoothness 
of its coefficients. The totality of all forms of degree p > 0 with coefficients of class 
C‘©)(D,R) is most often denoted Q?(D, R) or Q?. 

Thus the operation of differentiation of forms that we have defined effects a map- 
ping d: 2? > QPt!. 

Let us consider several useful specific examples. 


Example 9 For a 0-form w = f(x, y,z) — a differentiable function — defined in a 
domain D C R?, we obtain 


Example 10 Let 
w(x, y) = P(x, y)dx + Q(x, y) dy 


be a differential 1-form in a domain D of R* endowed with coordinates (x, y). 
Assuming that P and Q are differentiable in D, by Definition 2 we obtain 


dw(x, vy) =dPAdx+dQAdy= 


oP oP 0 0 
= | —dx + —dy})Adx+ Wi 22 a, Ady = 
Ox oy ox dy 


oP a 0 oP 
= —dyAdx+ oO tends (32 - = owas A dy. 
dy ox ox dy 
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Example 11 Fora 1-form 
w= Pdx+ Qdy+ Rdz 


defined in a domain D in R? we obtain 


R P R P 
da= uh 28 dy Adz+ eae dz A dx + a SE dx A dy. 
dy Oz dz Ox ax dy 


Example 12 Computing the differential of the 2-form 
w= PdyAdz+ QdzAdx+ Rdx Ady, 


where P, Q, and R are differentiable in the domain D C R3, leads to the relation 


aP a OR 
dw = eee dx A dy A dz. 
ax dy Oz 


If (x!,x?,x3) are Cartesian coordinates in the Euclidean space R? and xb 
f(x), x F(x) = (F!, F’, F?)(x), and x BH V = (V!, V?, V7)(x) are smooth 
scalar and vector fields in the domain D Cc R?, then along with these fields, we 
often consider the respective vector fields 


of of of 
ax!” Ax2’ ax3 


OF? OF? OF! oF? aF? OF! 
curl F = 


grad f = ( ) the gradient of f, (12.24) 


ax2 ax3’ ax3— ax!’ ax! 7) the curlofF, = (12.25) 


and the scalar field 


av! av? av? 


~ ax! © ax? Ax3 


the divergence of V. (12.26) 


We have already mentioned the gradient of a scalar field earlier. Without dwelling 
on the physical content of the curl and divergence of a vector field at the moment, 
we note only the connections that these classical operators have with the operation 
of differentiating forms. 

In the oriented Euclidean space R° there is a one-to-one correspondence between 
vector fields and 1- and 2-forms: 


F< op=(F,:), VsoyV(V,-,-)- 


We remark also that every 3-form in the domain D C R°? has the form p(x!, x2, 
x3) dx! A dx? A dx. Taking this circumstance into account, one can introduce the 


following definitions for grad f, curl F, and div V: 


fro (= f) PR do (=df) =o, g:= grad f, (12.24’) 
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FR op dop=o2h r:=culF, (12.25’) 
Vib wy > doy = 03> p:=divV. (12.26’) 


Examples 9, 11, and 12 show that when we do this in Cartesian coordinates, we 
arrive at the expressions (12.24), (12.25), and (12.26) above for grad f, curl F, and 
div V. Thus these operators in field theory can be regarded as concrete manifesta- 
tions of the operation of differentiation of exterior forms, which is carried out in 
a single manner on forms of any degree. More details on the gradient, curl, and 
divergence will be given in Chap. 14. 


12.5.4 Transformation of Vectors and Forms Under Mappings 


Let us consider in more detail what happens with functions (O-forms) under a map- 
ping of their domains. 

Let gy: U > V be a mapping of the domain U Cc R” into the domain V C R”. 
Under the mapping ¢ each point t € U maps to a definite point x = g(t) of the 
domain V. 

If a function f is defined on V, then, because of the mapping 9g: U > Va 
function g* f naturally arises on the domain U, defined by the relation 


(o* f)® := f(e@), 


that is, to find the value of y* f at a point t € U one must send f to the point x = 
g(t) € V and compute the value of f at that point. 

Thus, if the domain U maps to the domain V under the mapping 9g: U > V, 
then the set of functions defined on V maps (in the opposite direction) to the set of 
functions defined on U under the correspondence f +> g* f just defined. 

In other words, we have shown that a mapping ¢”* : 2°(V) > 2°(U) transform- 
ing 0-forms defined on V into 0-forms defined on U naturally arises from a mapping 
g:U-V. 

Now let us consider the general case of transformation of forms of any degree. 

Let g: U > V be a smooth mapping of a domain U C R” into a domain 
V CRY, and g'(t): TU; > TV,=g 1) the mapping of tangent spaces corresponding 
to g, and let w be a p-form in the domain V. Then one can assign to w the p-form 
y*w in the domain U defined at t € U on the set of vectors T|,..., Tp € TU; by the 
equality 


gwl(t)(T1,...,Tp) = (Gt) (Yj 71... QpT p)- (12.27) 


Thus to each smooth mapping g : U > V there corresponds a mapping a” : 
2?(V) > 2P(U) that transforms forms defined on V into forms defined on U. It 
obviously follows from (12.27) that 


y* (0! +0") =9*(o')+9*(0"), (12.28) 
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y* (Aq@) — Ag*a, ifAER. (12.29) 


Recalling the rule (wo gy)’ = W’ og’ for differentiating the composition of the 
mappings 9g: U > V, w: V > W, we conclude in addition from (12.27) that 


(ogy =g* ov" (12.30) 
(the natural reverse path: the composition of the mappings) 
w*:2?(W) > 2? (V), g* :2?(V) > QU). 
Now let us consider how to carry out the transformation of forms in practice. 


Example 13 In the domain V C R" let us take the 2-form w = dx!! A dx’2. Let 
xi=x! (t!, ...,f"),i=1,...,n, be the coordinate expression for the mapping ¢ : 
U — V of adomain U C R"” into V. 

We wish to find the coordinate representation of the form g*@ in U. We take 
a point t € U and vectors t1,t2 € TU;. The vectors &; = y’(t)t and &) = 


y'(t)t2 correspond to them in the space TVx=gc1). The coordinates (& e fabs &7) 
and (ieee) of these vectors can be expressed in terms of the coordinates 
Gas wee, 77”) and Gai ...,T7)') of T, and T2 using the Jacobian matrix via the for- 
mulas 

- ax! ax! 

—_— J | eee J ae 

= ag (t)t], &= aE (t)t;, t=1,...,n. 
(The summation on j runs from | to m.) 
Thus, 


g*w(t)(T1, T2) = w( V(t) (Ey, 2) = dx"! A dx? (E), 85) = 


axl fi ax!2 _ ja 


iy in ; : 
_ & Ey ari “1 ar 1 
~ felt gi) |axt fi ax? | 
52 8 ar "2 = aria 2 
s Ox Ox jaf a? 
a até ore | JI i 
A, j=l SS 
m j i 
Ox" ax . 
= a an OO G2) = 


A, p=l 


Ax! Ax?2 Axl axl2\ 
> ( ss ais ) ar nari (ry,r0) = 


Ot’! Ot = ate2 ats 


I<ji<josm 


ax! ax!2 
atl ars j j 
=e » sn ack (t) dt/! A dt/2(t1, 72). 


I<ji<jsm| a2 9P 
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Consequently, we have shown that 


. A(x!l, x!2) ; 
*(qyil in) _ jl ja 
g* (dx! A dx!2) = pe 5G (t) dt!) A dr?2. 
1<i, <ig<m 
If we use properties (12.28) and (12.29) for the operation of transformation of 
forms” and repeat the reasoning of the last example, we obtain the following equal- 


ity: 


o( > Giy,..4ip (X) dx!! rv-nax'r) = 


1Sij <---<ip<n 


oe eee 
= > Giy,..., LO) aa ay A+: A dtl. (12.31) 
1Sij <+--<ip<n Doe sey 
l<jj<-++<jp<m 


We remark that if we make the formal change of variable x = x(t) in the form 
that is the argument of y* on the left, express the differentials dx!,...,dx” in terms 
of the differentials dt!,..., dr”, and gather like terms in the resulting expression, 
using the properties of the exterior product, we obtain precisely the right-hand side 
of Eq. (12.31). 


Indeed, for each fixed choice of indices i), ..., i) we have 
Git,..., jdx" Asn ROS 
1 . j 
Alyy. AV... 
cna ti) nn (Ba) 
ox!! axip 


l<ji<--jpsm 


Summing such equalities over all ordered sets 1 <i) <--- <i» <n, we obtain the 
right-hand side of (12.31). 
Thus we have proved the following proposition, of great technical importance. 


Proposition [f a differential form w is defined in a domain V C R" andg:U > V 
is a smooth mapping of a domain U C R" into V, then the coordinate expression 


Tf (12.29) is used pointwise, one can see that 


yo (a (x)o) =a (g(t) g* a. 
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of the form y*@ can be obtained from the coordinate expression 


> iy, ip (X) dx'l A .-- A dx!? 


1Si, <---<ip<n 


of the form w by the direct change of variable x = y(t) (with subsequent transfor- 
mations in accordance with the properties of the exterior product). 


Example 14 In particular, if m =n = p, relation (12.31) reduces to the equality 
p* (dx! A---Adx") = detg’(t) dt! A--- A dt". (12.32) 


Hence, if we write f(x)dx! A --- A dx” in a multiple integral instead of 
f(x)dx!---dx”, the formula 


/ f(x) dx =i f(g) det y'(r) dt 
V=9U) U 


for change of variable in a multiple integral via an orientation-preserving diffeomor- 
phism (that is, when det y’(t) > 0) could be obtained automatically by the formal 
substitution x = g(t), just as happened in the one-dimensional case, and it could be 


given the following form: 
/ w= | Qo. (12.33) 
ge) U 


We remark in conclusion that if the degree p of the form w in the domain V Cc R? 
is larger than the dimension m of the domain U Cc R” that is mapped into V via 
y:U = V, then the form g*w on U corresponding to w is obviously zero. Thus the 
mapping y* : 2?(V) > 2°?(U) is not necessarily injective in general. 

On the other hand, if gy : U > V has a smooth inverse y~! : V — U, then by 
(12.30) and the equalities p~! 0g = ey, poy! = ey, we find that (g)* 0 (g~!)* = 
ey, and (p-!)* og* = ey. And, since e7, and ej, are the identity mappings on 
QP (U) and 2? (V) respectively, the mappings y* : Q?(V) > Q?(U) and (g~!)*: 
2P?(U) > 2°?(V), as one would expect, turn out to be inverses of each other. That 
is, in this case, the mapping g* : 2?(V) > 2? (U) is bijective. 

We note finally that along with the properties (12.28)-(12.30) the mapping g* 
that transfers forms, as one can verify, also satisfies the relation 


y* (dw) = d(g* a). (12.34) 


This theoretically important equality shows in particular that the operation of 
differentiation of forms, which we defined in coordinate notation, is actually inde- 
pendent of the coordinate system in which the differentiable form w is written. This 
will be discussed in more detail in Chap. 15. 
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12.5.5 Forms on Surfaces 


Definition 3 We say that a differential p-form w is defined on a smooth surface 
S CR" if a p-form w(x) is defined on the vectors of the tangent plane TS, to S at 
each point x € S. 


Example 15 If the smooth surface S is contained in the domain D C R” in which 
a form q is defined, then, since the inclusion TS, Cc TD, holds at each point x € S, 
one can consider the restriction of w(x) to TS,. In this way a form @|5 arises, which 
it is natural to call the restriction of w to S. 


As we know, a surface can be defined parametrically, either locally or globally. 
Let gp: U ~ S=@(U) C D bea parametrized smooth surface in the domain D and 
o@ aform on D. Then we can transfer the form w to the domain U of parameters and 
write y*w in coordinate form in accordance with the algorithm given above. It is 
clear that the form y*q@ in U obtained in this way coincides with the form g*(w|s). 

We remark that, since g’(t) : TU; + TS, is an isomorphism between TU; and 
TS, at every point t € U, we can transfer forms both from S to U and from U to S, 
and so just as the smooth surfaces themselves are usually defined locally or globally 
by parameters, the forms on them, in the final analysis, are usually defined in the 
parameter domains of local charts. 


Example 16 Let wy be the flux form considered in Example 8, generated by the 
velocity field V of a flow in the domain D of the oriented Euclidean space R*. If § 
is a smooth oriented surface in D, one may consider the restriction wy |s of the form 
wy to S. The form wy ls so obtained characterizes the flux across each element of 
the surface S. 

If g: I > S isa local chart of the surface S, then, making the change of variable 
x = g(t) in the coordinate expression (12.22) for the form wy we obtain the coor- 
dinate expression for the form voy =" (oy | s), which is defined on the square /, 
in these local coordinates of the surface. 


Example 17 Let On be the work form considered in Example 7, generated by the 
force field F acting in a domain D of Euclidean space. Let g: I > g(UW) Cc D be 
a smooth path (@ is not necessarily a homeomorphism). Then, in accordance with 
the general principle of restriction and transfer of forms, a form g* op arises on the 
closed interval J, whose coordinate representation a(t) dt can be obtained by the 


change of variable x = g(t) in the coordinate expression (12.21) for the form Op. 


12.5.6 Problems and Exercises 


1. Compute the values of the differential forms w in R” given below on the indi- 
cated sets of vectors: 
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a) w= x* dx! on the vector € = (1, 2,3) € TRG,2,1)- 

b) m = dx! A dx? + x! dx? A dx* on the ordered pair of vectors &,,&> € 
124 

R1,0,0,0)" 

c) w=df, where f =x! 4+2x74---+nx",andé =(1,-,1,...,(-D""Ye 
TR 


~ 


n 
(,1,...,1)" 


2. a) Verify that the form dx a---Adxik is identically zero if the indices i1,..., ix 
are not all distinct. 

b) Explain why there are no nonzero skew-symmetric forms of degree p > n on 
an n-dimensional vector space. 

c) Simplify the expression for the form 


2dx! A dx? A dx” + 3dx> A dx! Adx* —dx* Adx? Adz’. 
d) Remove the parentheses and gather like terms: 
(x dx? 4+ x? dx!) A (x? dx! A dx? +x? dx! Adx? +x! dx? A dx?). 
e) Write the form df A dg, where f = In(1 + |x|), g = sin|x|, and x = 
(x!, x, x3) as a linear combination of the forms dx!! A dx!2, 1 <i, <in <3. 


f) Verify that in R” 


af! 


axJ 


ay: rod gna) = det( Jenar! Ass A dx", 


g) Carry out all the computations and show that for 1 <k <n 


afl af! 
} k axil ax'k i ig 
df’ A---Adf* = > det aft aft dx aA.-e A dx. 
1<i) <in<-<ig<n ay sees ati 


3. a) Show that a form a of even degree commutes with any form #, that is, a A 6B = 
Baa. 


b) Let w= -"_, dp; Adq! and wo" =w A--- Aq (n factors). Verify that w” = 
n(n—1) 
2 


nidp, Adg! A-++Adpn A dg” = (—1) dpi A---Adpn Adq! A-+-Adq". 


4. a) Write the form w = df, where f(x) = (x!)? + (x7)? +--- + (x")’, asa 
combination of the forms dx!,...,dx” and find the differential dw of w. 

b) Verify that d? f = 0 for any function f ¢ C®(D,R), where d* = dod, and 
d is exterior differentiation. 

c) Show that if the coefficients a;,___;, of the form w = aj,,__. i, (X) dx!l A.A 
dxit belongs to the class C®(D, R), then d2@ = 0 in the domain D. 


d) Find the exterior differential of the form ~ oat in its domain of definition. 


5. If the product dx!---dx” in the multiple integral PP ps) dx!..-dx” is inter- 
preted as the form dx! A --- A dx”, then, by the result of Example 14, we have the 
possibility of formally obtaining the integrand in the formula for change of variable 
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in a multiple integral. Using this recommendation, carry out the following changes 
of variable from Cartesian coordinates: 


a) to polar coordinates in R*, 
b) to cylindrical coordinates in R, 
c) to spherical coordinates in R?. 


6. Find the restriction of the following forms: 


a) dx! to the hyperplane x! = 1. 

b) dx A dy to the curve x = x(t), y=y(t),a<t<b. 

c) dx A dy to the plane in R? defined by the equation x = c. 

d) dy Adz+dz A dx + dx A dy to the faces of the standard unit cube in R?. 


e) aj =dx! A---Adx!~! Adx! Adx't! A... A dx" to the faces of the standard 
unit cube in R”. The symbol — stands over the differential dx’ that is to be omitted 
in the product. 


7. Express the restriction of the following forms to the sphere of radius R with 
center at the origin in spherical coordinates on R?: 


a) dx, 
b) dy, 
c) dy Adz. 


8. The mapping gy : R* — R? is given in the form (u, v) + (u-v, 1) = (x, y). Find: 


a) g* (dx), 
b) y* (dy), 
c) y*(ydx). 


9. Verify that the exterior differential d: 2?(D) — @?+!(D) has the following 
properties: 


a) d(w1 + a2) = da + dw, 
b) d(@, A @2) = da; A w+ (—1) 881 @ \ d@2, where deg w, is the degree of 
the form @). 
c) Vwe 2Pd(dwa)=0. 
d) Vf e 2°df =r, Gas’. 
Show that there is only one mapping d: 2?(D) > 2?*!(D) having proper- 
ties a), b), c), and d). 


10. Verify that the mapping g* : 2?(V) > @?(U) corresponding to a mapping 
g:U — V has the following properties: 


a) g* (a1 + @2) = 9* a) + G*@>. 

b) g*(@1 A @2) = g* a1 A g* an. 

c) dg*w= g* da. 

d) If there is a mapping w: V > W, then (Wo g)*=g* oy*. 


11. Show that a smooth k-dimensional surface is orientable if and only if there 
exists a k-form on it that is not degenerate at any point. 


Chapter 13 
Line and Surface Integrals 


13.1 The Integral of a Differential Form 


13.1.1 The Original Problems, Suggestive Considerations, 
Examples 


a. The Work of a Field 


Let F(x) be a continuous force field acting in a domain G of the Euclidean space R”. 
The displacement of a test particle in the field is accompanied by work. We ask how 
we can compute the work done by the field in moving a unit test particle along a 
given trajectory, more precisely, a smooth path y: I > yd) CG. 

We have already touched on this problem when we studied the applications of the 
definite integral. For that reason we can merely recall the solution of the problem 
at this point, noting certain elements of the construction that will be useful in what 
follows. 

It is known that in a constant field F the displacement by a vector & is associated 
with an amount of work (F, &). 

Let t + x(t) be a smooth mapping y : J > G defined on the closed interval 
Il={teR|a<t<bD}. 

We take a sufficiently fine partition of the closed interval [a, b]. Then on each 
interval J; = {t € I | t;-1 <t <t;} of the partition we have the equality x(t) — 
x(t;) © x’(t)(t; — t;-1) up to infinitesimals of higher order. To the displacement 
vector T; = tj41 — t; from the point ¢; (Fig. 13.1) there corresponds a displacement 
of x(t;) in R” by the vector Ax; = x;+; — x;, which can be regarded as equal to 
the tangent vector &; = x(t;)t; to the trajectory at x(¢;) with the same precision. 
Since the field F(x) is continuous, it can be regarded a locally constant, and for that 
reason we can compute the work AA; corresponding to the (time) interval 7; with 
small relative error as 


AA; © (F(x;), &;) 
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Fig. 13.1 é; 


ti ti41 


or 
AA; © (F(x(4)), X(t; 7). 
Hence, 
A=) 0 AA; S (F(x(t)), XG) Ati 
i i 
and so, passing to the limit as the partition of the closed interval J is refined, we find 
that 


b 
A= f (R(x). x) ar (13.1) 


If the expression (F(x(t)), x(f)) df is rewritten as (F(x), dx), then, assuming the 
coordinates in IR” are Cartesian coordinates, we can give this expression the form 
F!dx!+.-..+ F" dx", after which we can write (13.1) as 


A= f Flax! 4 Fray" (13.2) 
Y 


or as 
A= [ op. (13.2’) 
¥ 


Formula (13.1) provides the precise meaning of the integrals of the work 1-form 
along the path y written in formulas (13.2) and (13.2’). 


Example I Consider the force field F = Gree ao) defined at all points of 
the plane R? except the origin. Let us compute the work of this field along the 
curve y; defined as x = cost, y = sint, 0 < tf < 27, and along the curve defined 
by x =2+ cost, y=sint, 0 <t < 27. According to formulas (13.1), (13.2), and 


(13.2), we find 


[ot=f eae eee 
7 * x24 y2 x2 + y? 
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2x / sint - (—sint) cost - cost 
= ais —~ } dt = 20 
0 cos?t+sin°tf cos?t+sin*t 


i 1 / —ydx+xdy [- — sint(— sint) + (2+ cost)(cost) a 
Op, = a -a- a — 
” wy wy 0 (2+ cost)? + sin’ t 


[ 1+2cost =i 1+2cost pase _ 
0 I+4cost 0 3+4cost 7 S+4cos2Qr—u) 


™ 1+2cost ™ 1+2cosu 

0 3+4cost 90 3+4cosu 
Example 2 Let r be the radius vector of a point (x, y, z) € R? and r = |r|. Suppose 
a force field F = f(r)r is defined everywhere in R? except at the origin. This is a 


so-called central force field. Let us find the work of F on a path y : [0, 1] > R°\0. 
Using (13.2), we find 


[ roars yay +24 =5 ff pena? ty? +2) = 
ie y 


1 


1 1 1 
= al f(r@)) dr7(t) = al f (u(t) du(t) = 
0 0 
1 ft 
=F) fl du=e(r.r), 
a) 


Here, as one can see, we have set x7(t) + y(t) + 27(t) =r7(), r7(t) = u(t), 
ro =r(0), andr; =r(1). 

Thus in any central field the work on a path y has turned out to depend only on 
the distances ro and r; of the beginning and end of the path from the center 0 of the 
field. 

In particular, for the gravitational field ar of a unit point mass located at the 
origin, we obtain 


P “1ptd ae 
(ro. = 5 r2 ur/2 o= ¥ a 


b. The Flux Across a Surface 


Suppose there is a steady flow of liquid (or gas) in a domain G of the oriented 
Euclidean space R? and that x +> V(x) is the velocity field of this flow. In addition, 
suppose that a smooth oriented surface S has been chosen in G. For definiteness we 
shall suppose that the orientation of S is given by a field of normal vectors. We ask 
how to determine the (volumetric) outflow or flux of fluid across the surface S. More 
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Fig. 13.2 


precisely, we ask how to find the volume of fluid that flows across the surface S' per 
unit time in the direction indicated by the orienting field of normals to the surface. 

To solve the problem, we remark that if the velocity field of the flow is constant 
and equal to V, then the flow per unit time across a parallelogram IT spanned by 
vectors &, and &, equals the volume of the parallelepiped constructed on the vectors 
V, &,, &5. If 9 is normal to /7 and we seek the flux across /7 in the direction of 7, 
it equals the scalar triple product (V, &,, >), provided 7 and the frame &,, 5 give 
IT the same orientation (that is, if 7, &,, &> is a frame having the given orientation 
in R?). If the frame &,, €) gives the orientation opposite to the one given by y in J7, 
then the flow in the direction of 7 is —(V, &,, &>). 

We now return to the original statement of the problem. For simplicity let us 
assume that the entire surface S admits a smooth parametrization g: ] > SCG, 
where J is a two-dimensional interval in the plane R*. We partition J into small 
intervals J; (Fig. 13.2). We approximate the image g(J;) of each such interval by 
the parallelogram spanned by the images &, = g’(t;)t, and &) = y’(t;)t2 of the 
displacement vectors T;, T2 along the coordinate directions. Assuming that V(x) 
varies by only a small amount inside the piece of surface g(/;) and replacing g(/;) 
by this parallelogram, we may assume that the flux AF; across the piece g(/;) of 
the surface is equal, with small relative error, to the flux of a constant velocity field 
V(x) = V(@(t)) across the parallelogram spanned by the vectors & |, &5. 

Assuming that the frame &,, 5 gives the same orientation on S as 7, we find 


AF; © (W(xi), €1, €2). 


Summing the elementary fluxes, we obtain 


F= > AF; © S > wy (xi) (1, £2). 


where wy (x) = (V(x), -,-) is the flux 2-form (studied in Example 8 of Sect. 12.5). 
If we pass to the limit, taking ever finer partitions P of the interval /, it is natural to 
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assume that 


(P)> 


F:= ii 9 (Xi)(B 1,8) =: | ay. 13.3 
im ov) (E1, €2) [os (13.3) 
This last symbol is the integral of the 2-form wy over the oriented surface S. 

Recalling (formula (12.22) of Sect. 12.5) the coordinate expression for the flux 
form wy in Cartesian coordinates, we may now also write 


F=f vids? dx? + v2 dx? adr! + V3 dx! Ade? (13.4) 
Ss 


We have discussed here only the general principle for solving this problem. In 
essence all we have done is to give the precise definition (13.3) of the flux F and 
introduced certain notation (13.3) and (13.4); we have still not obtained any effective 
computational formula similar to formula (13.1) for the work. 

We remark that formula (13.1) can be obtained from (13.2) by replacing 
x!,...,x” with the functions (x!,...,x”)(t) = x(t) that define the path y. We re- 
call (Sect. 12.5) that such a substitution can be interpreted as the transfer of the form 
w defined in G to the closed interval J = [a, b]. 

In a completely analogous way, a computational formula for the flux can be ob- 
tained by direct substitution of the parametric equations of the surface into (13.4). 

In fact, 


wy (xi) (E 1, €2) = ov (9(H)) (9 (tH) 1, 9 (ti) t2) = (p* oy) (ti) (11, 72) 


and 


l 


Yo oy iE 1, &2) = Do (g* oy) (4) (1, 72). 


The form poy is defined on a two-dimensional interval J Cc R?. Any 2-form 


in J has the form f(t) dt! A dt*, where f is a function on J depending on the form. 
Therefore 


g* wy (ti)(t1, 72) = f (ti) dt! A dt?(t1, 12). 


But dt! a dt? (r1, T2)= in . te is the area of the rectangle J; spanned by the 
orthogonal vectors T1, T2. 
Thus, 


Yo f(t dt! a de? (e1, 02) = D> fH) fil. 
i i 
As the partition is refined we obtain in the limit 
[to dt! adr’? = / f(t) dt! dr’, (13.5) 
where, according to (13.3), the left-hand side contains the integral of the 2-form 


w” = f (t) dt! A dt? over the elementary oriented surface /, and the right-hand side 
the integral of the function f over the rectangle /. 
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It remains only to recall that the coordinate representation f(t) dt! A dt of the 
form y* wy is obtained from the coordinate expression for the form wy by the direct 
substitution x = g(t), where g: J > G is achart of the surface S. 

Carrying out this change of variable, we obtain from (13.4) 


Fe wy, = / g* wy = 
S=9(1) I 


I at! 2 at! ar! 
=|] | v'(e@)| ” V* (v(t 
I (PO)) 2 as |TV (CO) a5 ant 
at2 sat at ar 
ax! ax? 
3 ar! ar! 1 2 
+ V°(g@) al ae dt! A dt’. 
at ar 


This last integral, as Eq. (13.5) shows, is the ordinary Riemann integral over the 
rectangle /. 
Thus we have found that 


VIe@®) VEO) Ve) 


1 2 a 3 
$2 if eo Bey Bey | ala, (13.6) 
I 1 2 3 
eo Sa Bw 


where x = g(t) = (g!, ¢°, ge (t!, t”) is a chart of the surface S$ defining the same 
orientation as the field of normals we have given. If the chart g : I — S gives S the 
opposite orientation, Eq. (13.6) does not generally hold. But, as follows from the 
considerations at the beginning of this subsection, the left- and right-hand sides will 
differ only in sign in that case. 

The final formula (13.6) is obviously merely the limit of the sums of the elemen- 
tary fluxes AF; ~ (V(x;), &,, €>) familiar to us, written accurately in the coordi- 
nates t! and ??. 

We have considered the case of a surface defined by a single chart. In general 
a smooth surface can be decomposed into smooth pieces S$; having essentially no 
intersections with one another, and then we can find the flux through S as the sum 
of the fluxes though the pieces S;. 


Example 3 Suppose a medium is advancing with constant velocity V = (1, 0, 0). 
If we take any closed surface in the domain of the flow, then, since the density of 
the medium does not change, the amount of matter in the volume bounded by this 
surface must remain constant. Hence the total flux of the medium through such a 
surface must be zero. 

In this case, let us check formula (13.6) by taking S to be the sphere x* + y? + 
a) ae 
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Up to a set of area zero, which is therefore negligible, this sphere can be defined 
parametrically 


x = Reosycos¢@, 
y= Reosysing, 
z= Rsiny, 


where 0 < g < 2m and —17/2<y<a7/2. 
After these relations and the relation V = (1, 0, 0) are substituted in (13.6), we 
obtain 


ax x7 x/2 on 
arta! 2 2 
f= axl a2 dgdy=R cos* w dy cosydg = 0. 
‘\ oF af sl 0 


Since the integral equals zero, we have not even bothered to consider whether it 
was the inward or outward flow we were computing. 


Example 4 Suppose the velocity field of a medium moving in R? is defined in 
Cartesian coordinates x, y,z by the equality V(x, y, z) = (Vi VA. VA, yY,2= 
(x, y, z). Let us find the flux through the sphere x* + y? + z* = R? into the ball that 
it bounds (that is, in the direction of the inward normal) in this case. 

Taking the parametrization of the sphere given in the last example, and carrying 
out the substitution in the right-hand side of (13.6), we find that 


Rcoswcosg Rcoswsing Rsinw 


20 m/2 
/ ap | —Rcoswsing Rcoswcosg¢ 0 dg = 
m “7?2) R sinyrcosg  —Rsinwsing Rcosw 


20 m/2 
=f ay | R? cosw dw =47R?. 
0 —1/2 


We now check to see whether the orientation of the sphere given by the curvi- 
linear coordinates (gy, Ww) agrees with that given by the inward normal. It is easy to 
verify that they do not agree. Hence the required flux is given by F = —4z R?. 

In this case the result is easy to verify: the velocity vector V of the flow has 
magnitude equal to R at each point of the sphere, is orthogonal to the sphere, and 
points outward. Therefore the outward flux from the inside equals the area of the 
sphere 47 R? multiplied by R. The flux in the opposite direction is then —4z R?. 


13.1.2 Definition of the Integral of a Form over an Oriented 
Surface 


The solution of the problems considered in Sect. 13.1.1 leads to the definition of the 
integral of a k-form over a k-dimensional surface. 
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First let S be a smooth k-dimensional surface in R”, defined by one standard 
chart g : J — S. Suppose a k-form @ is defined on S. The integral of the form 
over the parametrized surface gy : J — S is then constructed as follows. 

Take a partition P of the k-dimensional standard interval J C R” induced by 
partitions of its projections on the coordinate axes (closed intervals). In each in- 
terval J; of the partition P take the vertex ft; having minimal coordinate val- 


ues and attach to it the k vectors T1,...,t7,% that go along the direction of 
the coordinate axes to the k vertices of J; adjacent to ¢; (Fig. 13.2). Find the 
vectors €; = g'(t))T1,...,€ = g’(t))t of the tangent space TS,,—g(,), then 
compute w(x;)(&),...,&) =: (*w)(t;)) (11, ..., T%), and form the Riemann sum 


>>; @(41) (E 1, ..-, &). Then pass to the limit as the mesh A(P) of the partition tends 
to zero. 
Thus we adopt the following definition: 


Definition 1 (Integral of a k-form w over a given chart g : J > S of a smooth k- 
dimensional surface.) 


fo: eee Don Gr.--- B=, Hi (y*w) (t))(T1,.-., Tk). (13.7) 


If we apply this definition to the k-form f(t)dt! A --- A dt* on I (when ¢ is the 
identity mapping), we obviously find that 


[ sera! as natts f pear’ .--art. (13.8) 
I I 


It thus follows from (13.7) that 


/ o= | oe. (13.9) 
S=o(1) I 


and the last integral, as Eq. (13.8) shows, reduces to the ordinary multiple integral 
over the interval J of the function f corresponding to the form g*w. 

We have derived the important relations (13.8) and (13.9) from Definition 1, but 
they themselves could have been adopted as the original definitions. In particular, if 
D is an arbitrary domain in R” (not necessarily an interval), then, so as not to repeat 
the summation procedure, we set 


[ fooat a natt= f papart..-at, (13.8’) 
D D 


and for a smooth surface given in the form g: D > S and ak-form @ on it we set 


/ om | y*o. (13.9’) 
S=9(D) D 
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If S is an arbitrary piecewise-smooth k-dimensional surface and w is a k-form 
defined on the smooth pieces of S, then, representing S as the union |_); S; of smooth 
parametrized surfaces that intersect only in sets of lower dimension, we set 


jay] o. (13.10) 
s 7 Si 


In the absence of substantive physical or other problems that can be solved using 
(13.10), such a definition raises the question whether the magnitude of the integral of 
the partition |_); S; is independent of the choice of the parametrization of its pieces. 

Let us verify that this definition is unambiguous. 


Proof We begin by considering the simplest case in which S is a domain D, in Ré 
and g : D; —> Dy, is a diffeomorphism of a domain D; C Ré onto D,. In D, = S the 
k-form @ has the form f(x) dx! \.-- A dx*. Then, on the one hand (13.8) implies 


J. fenart an -naxts f FON dt <odx*, 
Dx Dx 


On the other hand, by (13.9’) and (13.8’), 


i, w= | vw= | f(g(t)) det g’(t) dt! ---de*. 
ra D: Dr 


But if det g’(t) > 0 in D;, then by the theorem on change of variable in a multiple 
integral we have 


/ flx)dr! dst = f F(g(t)) dety’(t) dt! ---dr*. 
D:=9(D;) 


t 


Hence, assuming that there were coordinates xt, 4 x*inS= D,. and curvilin- 
ear coordinates t!,... ; t* of the same orientation class, we have shown that the value 
of the integral 5 @ is the same, no matter which of these two coordinate systems is 
used to compute it. 

We note that if the curvilinear coordinates t!, ..., t* had defined the opposite ori- 
entation on S, that is, det y’(t) < 0, the right- and left-hand sides of the last equality 
would have had opposite signs. Thus, one can say that the integral is well-defined 
only in the case of an oriented surface of integration. 

Now let g, : Dy — S and g; : D; — S be two parametrizations of the same 
smooth k-dimensional surface S and w a k-form on S. Let us compare the integrals 


[ ve and [ ee. (13.11) 
Dy D; 


Since 9 = @; 0 (gy! 09+) = Gy Og, where y = gy! og, : Di > Dy, is a diffeomor- 
phism of D; onto D,, it follows that g*w = y* (yt) (see Eq. (12.30) of Sect. 12.5). 
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Hence one can obtain the form yfw in D; by the change of variable x = y(t) in the 
form g¥w. But, as we have just verified, in this case the integrals (13.11) are equal 
if det y’(t) > 0 and differ in sign if det g’(t) < 0. 

Thus it has been shown that if g, : D; > S and g, : D, — S are parametriza- 
tions of the surface S belonging to the same orientation class, the integrals (13.11) 
are equal. The fact that the integral is independent of the choice of curvilinear coor- 
dinates on the surface S has now been verified. 

The fact that the integral (13.10) over an oriented piecewise-smooth surface S$ 
is independent of the method of partitioning ); 5; into smooth pieces follows from 
the additivity of the ordinary multiple integral (it suffices to consider a finer partition 
obtained by superimposing two partitions and verify that the value of the integral 
over the finer partition equals the value over each of the two original partitions). 


On the basis of these considerations, it now makes sense to adopt the following 
chain of formal definitions corresponding to the construction of the integral of a 
form explained in Definition 1. 


Definition 1’ (Integral of a form over an oriented surface S C R”.) 


a) If the form f(x) dx! A--- A dx* is defined in a domain D C R*, then 


[ fonast a--nartx [ f(x) dx!.--dx*, 
D D 


b) If S Cc R” is a smooth k-dimensional oriented surface, ¢: D — S is a 
parametrization of it, and wm is a k-form on S, then 


fo=s| yg", 
S D 


where the + sign is taken if the parametrization g agrees with the given orientation 
of S and the — sign in the opposite case. 

c) If S is a piecewise-smooth k-dimensional oriented surface in R” and w is a 
k-form on S (defined where S has a tangent plane), then 


ehh 


where Sj,...,Sm,... iS a decomposition of S into smooth parametrizable k- 
dimensional pieces intersecting at most in piecewise-smooth surfaces of smaller 
dimension. 


We see in particular that changing the orientation of a surface leads to a change 
in the sign of the integral. 
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13.1.3 Problems and Exercises 


1. a) Let x, y be Cartesian coordinates on the plane R2. Exhibit the vector field 
whose work form is @ = Fay dx + Pay? dy. 
b) Find the integral of the form @ in a) along the following paths y;: 


y : 2 . 
[0,z] at ae (cost, sint) € R?: [0,z] St nes (cost, —sint) € R?: 


y3 consists of a motion along the closed intervals joining the points (1,0), (1, 1), 
(—1, 1), (—1, 0) in that order; y4 consists of a motion along the closed intervals 
joining (1,0), (1, —1), (—1, —1), (1, 0) in that order. 


2. Let f be a smooth function in the domain D C R” and y a smooth path in D 
with initial point pg € D and terminal point p,; € D. Find the integral of the form 
wo=df overy. 
3. a) Find the integral of the form w = dy A dz + dz A dx over the boundary of the 
standard unit cube in R? oriented by an outward-pointing normal. 

b) Exhibit a velocity field for which the form @ in a) is the flux form. 


4. a) Let x, y, z be Cartesian coordinates in R”. Exhibit a velocity field for which 
the flux form is 
xdy Adz+ ydzAdx+zdx Ady 
= @+y+23/7 


b) Find the integral of the form @ in a) over the sphere x? + y* + 77 = R? 
oriented by the outward normal. 


c) Show that the flux of the field atom across the sphere (x — 2)? + y* + 


z? = 1 is zero. 
d) Verify that the flux of the field in c) across the torus whose parametric equa- 
tions are given in Example 4 of Sect. 12.1 is also zero. 


5. It is known that the pressure P, volume V, and temperature T of a given quantity 
of a substance are connected by an equation f(P, V, T) = 0, called the equation of 
state in thermodynamics. For example, for one mole of an ideal gas the equation 
of state is given by Clapeyron’s formula iy — R=0, where R is the universal gas 
constant. 

Since P, V, T are connected by the equation of state, knowing any pair of them, 
one can theoretically determine the remaining one. Hence the state of any system 
can be characterized, for example, by points (V, P) of the plane R* with coordi- 
nates V, P. Then the evolution of the state of the system as a function of time will 
correspond to some path y in this plane. 

Suppose the gas is located in a cylinder in which a frictionless piston can move. 
By changing the position of the piston, we can change the state of the gas enclosed 
by the piston and the cylinder walls at the cost of doing mechanical work. Con- 
versely, by changing the state of the gas (heating it, for example) we can force the 
gas to do mechanical work (lifting a weight by expanding, for example). In this 
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Fig. 13.3 P 
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problem and in Problems 6, 7, and 8 below, all processes are assumed to take place 
so slowly that the temperature and pressure are able to average out at each particular 
instant of time; thus at each instant of time the system satisfies the equation of state. 
These are the so-called quasi-static processes. 


a) Let y be a path in the VP-plane corresponding to a quasi-static transition of 
the gas enclosed by the piston and the cylinder walls from state Vo, Po to Vj, Pi. 
Show that the quantity A of mechanical work performed on this path is defined by 
the line integral A = ie Pdv. 

b) Find the mechanical work performed by one mole of an ideal gas in passing 
from the state Vo, Po to state V;, P; along each of the following paths (Fig. 13.3): 
VoL, consisting of the isobar OL (P = Po) followed by the isochore LI (V = V); 
YOKI, consisting of the isochore OK (V = Vo) followed by the isobar KT (P = P}); 
yor, consisting of the isotherm T = const (assuming that Po Vo = P| V;). 

c) Show that the formula obtained in a) for the mechanical work performed by 
the gas enclosed by the piston and the cylinder walls is actually general, that is, it 
remains valid for the work of a gas enclosed in any deformable container. 


6. The quantity of heat acquired by a system in some process of varying its states, 
like the mechanical work performed by the system (see Problem 5), depends not 
only on the initial and final states of the system, but also on the transition path. An 
important characteristic of a substance and the thermodynamic process performed 
by (or on) it is its heat capacity, the ratio of the heat acquired by the substance to 
the change in its temperature. A precise definition of heat capacity can be given as 
follows. Let x be a point in the plane of states F' (with coordinates V, P or V, T 
or P,7T) and e € TF, a vector indicating the direction of displacement from the 
point x. Let t be a small parameter. Let us consider the displacement from the state 
x to the state x + te along the closed interval in the plane F whose endpoints are 
these states. Let A Q(x, te) be the heat acquired by the substance in this process and 
AT (x, te) the change in the temperature of the substance. 

The heat capacity C = C(x, e) of the substance (or system) corresponding to the 
state x and the direction e of displacement from that state is 

Ceieecine = 
t>0 AT (x, fe) 

In particular, if the system is thermally insulated, its evolution takes place without 
any exchange of heat with the surrounding medium. This is a so-called adiabatic 
process. The curve in the plane of states F corresponding to such a process is called 
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an adiabatic. Hence, zero heat capacity of the system corresponds to displacement 
from a given state x along an adiabatic. 

Infinite heat capacity corresponds to displacement along an isotherm T = const. 

The heat capacities at constant volume Cy = C(x, ey) and at constant pressure 
Cp = C(x, ep), which correspond respectively to displacement along an isochore 
V =const and an isobar P = const, are used particularly often. Experiment shows 
that in a rather wide range of states of a given mass of substance, each of the quan- 
tities Cy and Cp can be considered practically constant. The heat capacity corre- 
sponding to one mole of a given substance is customarily called the molecular heat 
capacity and is denoted (in contrast to the others) by upper case letters rather than 
lower case. We shall assume that we are dealing with one mole of a substance. 

Between the quantity AQ of heat acquired by the substance in the process, the 
change AU in its internal energy, and the mechanical work AA it performs, the 
law of conservation of energy provides the connection AQ = AU + AA. Thus, 
under a small displacement te from state x € F the heat acquired can be found as 
the value of the form 6Q := dU + P dV at the point x on the vector te € T F, (for 
the formula P dV for the work see Problem 5c)). Hence if T and V are regarded 
as the coordinates of the state and the displacement parameter (in a nonisothermal 
direction) is taken as T, then we can write 


. AQ oU aU dV dV 
C= lim = : +P s 
t>0 AT oT OV dT dT 


The derivative a determines the direction of displacement from the state x € F 


in the plane of states with coordinates T and V. In particular, if av = 0 then the 
displacement is in the direction of the isochore V = const, and we find that Cy = 
aU If P =const, then av — (25) paconst- (In the general case V = V(P, T) is the 


equation of state f(P, V, T) =0 solved for V.) Hence 


co=(5r), *((av), +*) (Gr), 


where the subscripts P, V, and T on the right-hand side indicate the parameter 
of state that is fixed when the partial derivative is taken. Comparing the resulting 
expressions for Cy and Cp, we see that 


cr-er=((%),+9)(%), 


By experiments on gases (the Joule'-Thomson experiments) it was established 
and then postulated in the model of an ideal gas that its internal energy depends only 
on the temperature, that is, (2o)r = 0. Thus for an ideal gas Cp — Cy = P(3%)p. 


'G-P. Joule (1818-1889) — British physicist who discovered the law of thermal action of a current 
and also determined, independently of Mayer, the mechanical equivalent of heat. 
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Taking account of the equation PV = RT for one mole of an ideal gas, we obtain the 
relation Cp — Cy = R from this, known as Mayer’s equation” in thermodynamics. 

The fact that the internal energy of a mole of gas depends only on temperature 
makes it possible to write the form 6Q as 


dU 
oo = ae Te a ye rey, 


To compute the quantity of heat acquired by a mole of gas when its state varies 
over the path y one must consequently find the integral of the form Cy dT + PdV 
over y. It is sometimes convenient to have this form in terms of the variables V and 
P. If we use the equation of state PV = RT and the relation Cp — Cy = R, we 
obtain 


$0265 av 2 Oy _aP 
SER ‘— 


a) Write the formula for the quantity Q of heat acquired by a mole of gas as its 
state varies along the path y in the plane of states F. 

b) Assuming the quantities Cp and Cy are constant, find the quantity Q corre- 
sponding to the paths you, Yoxr, and yo; in Problem 5b). 

c) Find (following Poisson) the equation of the adiabatic passing through the 
point (Vo, Po) in the plane of states F with coordinates V and P. (Poisson found that 
PV©r/Cv — const on an adiabatic. The quantity Cp/Cy is the adiabatic constant 
of the gas. For air Cp/Cy ~© 1.4.) Now compute the work one must do in order to 
confine a thermally isolated mole of air in the state (Vo, Po) to the volume V; = 5 Vo. 


7. We recall that a Carnot cycle? of variation in the state of the working body of a 
heat engine (for example, the gas under the piston in a cylinder) consists of the fol- 
lowing (Fig. 13.4). There are two energy-storing bodies, a heater and a cooler (for 
example, a steam boiler and the atmosphere) maintained at constant temperatures 7| 
and T> respectively (JT; > T>). The working body (gas) of this heat engine, having 
temperature 7; in State 1, is brought into contact with the heater, and by decreas- 
ing the external pressure along an isotherm, expands quasi-statically and moves to 
State 2. In the process the engine borrows a quantity of heat Q; from the heater and 
performs mechanical work Aj against the external pressure. In State 2 the gas is 
thermally insulated and forced to expand quasi-statically to State 3, until its tem- 
perature reaches 7>, the temperature of the cooler. In this process the engine also 
performs a certain quantity of work A23 against the external pressure. In State 3 the 
gas is brought into contact with the cooler and compressed isothermically to State 4 
by increasing the pressure. In this process work is done on the gas (the gas itself per- 
forms negative work A34), and the gas gives up a certain quantity of heat Q2 to the 


?J.P. Mayer (1814-1878) — German scholar, a physician by training; he stated the law of conserva- 
tion and transformation of energy and found the mechanical equivalent of heat. 


3N.L.S. Carnot (1796-1832) — French engineer, one of the founders of thermodynamics. 
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Fig. 13.4 P, 1 


cooler. State 4 is chosen so that it is possible to return from it to State 1 by a quasi- 
static compression along an adiabatic. Thus the gas is returned to State 1. In the 
process it is necessary to perform some work on the gas (and the gas itself performs 
negative work A4,). As a result of this cyclic process (a Carnot cycle) the internal 
energy of the gas (the working body of the engine) obviously does not change (af- 
ter all, we have returned to the initial state). Therefore the work performed by the 
engine is A = Aj2 + A23 + A34 + Agi = O1 — Qo. 

The heat Q; acquired from the heater went only partly to perform the work A. 
It is natural to call the quantity 7 = a = 21-22 the efficiency of the heat engine 
under consideration. 


a) Using the results obtained in a) and c) of Problem 6, show that the equality 
a = 22 holds for a Carnot cycle. 

b) Now prove the following theorem, the first of Carnot’s two famous theorems. 
The efficiency of a heat engine working along a Carnot cycle depends only on the 
temperatures T; and T of the heater and cooler. (It is independent of the structure 
of the engine or the form of its working body.) 


8. Let y be a closed path in the plane of states F of the working body of an arbitrary 
heat engine (see Problem 7) corresponding to a closed cycle of work performed by 
it. The quantity of heat that the working body (a gas, for example) exchanges with 
the surrounding medium and the temperature at which the heat exchange takes place 
are connected by the Clausius inequality J ae <0. Here 5Q is the heat exchange 
form mentioned in Problem 6. 


a) Show that for a Carnot cycle (see Problem 7), the Clausius inequality becomes 
equality. 

b) Show that if the work cycle y can be run in reverse, then the Clausius in- 
equality becomes equality. 

c) Let y; and y2 be the parts of the path y on which the working body of a 
heat engine acquires heat from without and imparts it to the surrounding medium 
respectively. Let T; be the maximal temperature of the working body on y and 7) 
its minimal temperature on y2. Finally, let Q; be the heat acquired on y; and Q2 
the heat given up on yz. Based on Clausius’ inequality, show that g: < P 
T\-T) 

T. 


d) Obtain the estimate 7 < for the efficiency of any heat engine (see Prob- 
lem 7). This is Carnot’s second theorem. (Estimate separately the efficiency of a 
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steam engine in which the maximal temperature of the steam is at most 150 °C, that 
is, 7) = 423 K, and the temperature of the cooler — the surrounding medium — is of 
the order 20 °C, that is T> = 291 K.) 

e) Compare the results of Problems 7b) and 8d) and verify that a heat engine 
working in a Carnot cycle has the maximum possible efficiency for given values of 
T, and 7). 


9. The differential equation we = f ) igs said to have variables separable. It is usu- 


ally rewritten in the form g(y) dy = f(x) dx, in which “the variables are separated,” 
then “solved” by equating the primitives [ g(y)dy = f f(x) dx. Using the language 
of differential forms, now give a detailed mathematical explanation for this algo- 
rithm. 


13.2 The Volume Element. Integrals of First and Second Kind 


13.2.1 The Mass of a Lamina 


Let S$ be a lamina in Euclidean space R”. Assume that we know the density p(x) 
(per unit area) of the mass distribution on S. We ask how one can determine the total 
mass of S. 

In order to solve this problem it is necessary first of all to take account of the fact 
that the surface density p(x) is the limit of the ratio Am of the quantity of mass on 
a portion of the surface in a neighborhood of x to the area Ao of that same portion 
of the surface, as the neighborhood is contracted to x. 

By breaking S into small pieces S; and assuming that p is continuous on S, we 
can find the mass of S;, neglecting the variation of p within each small piece, from 
the relation 


Am; © p(x) Ao;, 


in which Ao; is the area of the surface $; and x; € S;. 
Summing these approximate equalities and passing to the limit as the partition is 
refined, we find that 


m = | pas. (13.12) 
S 


The symbol for integration over the surface S' here obviously requires some clar- 
ification so that computational formulas can be derived from it. 

We note that the statement of the problem itself shows that the left-hand side 
of Eq. (13.12) is independent of the orientation of S, so that the integral on the 
right-hand side must have the same property. At first glance this appears to contrast 
with the concept of an integral over a surface, which was discussed in detail in 
Sect. 13.1. The answer to the question that thus arises is concealed in the definition 
of the surface element do, to whose analysis we now turn. 


13.2 The Volume Element. Integrals of First and Second Kind 229 


13.2.2 The Area of a Surface as the Integral of a Form 


Comparing Definition | of Sect. 13.1 for the integral of a form with the construction 
that led us to the definition of the area of a surface (Sect. 12.4), we see that the 
area of a smooth k-dimensional surface S embedded in the Euclidean space IR” and 
given parametrically by g : D — S, is the integral of a form {2, which we shall 
provisionally call the volume element on the surface S. It follows from relation 
(12.10) of Sect. 12.4 that 2 (more precisely g* @) has the form 


w= ,/det(g;;)(t) dt! A--- Ade", (13.13) 


in the curvilinear coordinates g : D — S (that is, when transferred to the domain D). 
dp dg, : ; 
Here gij(t) = (a8 ag) i f=l,-...k. : 
To compute the area of S over a domain D in a second parametrization @ : 
D — S, one must correspondingly integrate the form 


@ = ,/det(gi;)(f) di! A-»- A di*, (13.14) 


where g(#) = (2%, 98), i, j=1,...,k. 
We denote by y the diffeomorphism gy * o @: D > D that provides the change 
from ¢ coordinates to t coordinates on S. Earlier we have computed (see Remark 5 


of Sect. 12.4) that 


1 


Vdett&i@ = Vaev(gi) -|det y’(r)]. (13.15) 


At the same time, it is obvious that 


w*w = ,/det(gi;)(W@), detw/ (di! A--- Adi*. (13.16) 


Comparing the equalities (13.13)-(13.16), we see that y*w =o if det ’(f) > 0 
and w*w = —o if det y’(f) < 0. If the forms w and @ were obtained from the same 
form 2 on S through the transfers g* and @*, then we must always have the equality 
w*(o* 2) = G*Q or, what is the same, w*w =o. 

We thus conclude that the forms on the parametrized surface S that one must 
integrate in order to obtain the areas of the surface are different: they differ in sign 
if the parametrizations define different orientations on S; these forms are equal for 
parametrizations that belong to the same orientation class for the surface S. 

Thus the volume element 2 on S must be determined not only by the surface $ 
embedded in R”, but also by the orientation of S. 

This might appear paradoxical: in our intuition, the area of a surface should not 
depend on its orientation! 
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But after all, we arrived at the definition of the area of a parametrized surface via 
an integral, the integral of a certain form. Hence, if the result of our computations is 
to be independent of the orientation of the surface, it follows that we must integrate 
different forms when the orientation is different. 

Let us now turn these considerations into precise definitions. 


13.2.3 The Volume Element 


Definition 1 If R* is an oriented Euclidean space with inner product (, ), the volume 
element on R* corresponding to a particular orientation and the inner product (, ) 
is the skew-symmetric k-form that assumes the value | on an orthonormal frame of 
some orientation class. 


The value of the k-form on the frame e;,..., ex obviously determines this form. 
We remark also that the form §2 is determined not by an individual orthonormal 
frame, but only by its orientation class. 


Proof In fact, if ej,...,e, and @;,...,@, are two such frames in the same orien- 
tation class, then the transition matrix O from the second basis to the first is an 
orthogonal matrix with det O = 1. Hence 


Q(e,,...,e,) =detO- 2(e,...,€,) = Qe], ..., &x). 


If an orthonormal basis e1,...,e¢ is fixed in R* and z!,...,2* are the 


projections of R* on the corresponding coordinate axes, obviously 2! A --- A 
m*(e1,...,€%) = 1 and 


Q=n!n.--ank, 
Thus, 
é : a gk 
2(§),.-5€)= Bee Se 
yee 
This is the oriented volume of the parallelepiped spanned by the ordered set of 
vectors &),..., & . 


Definition 2 If the smooth k-dimensional oriented surface S is embedded in a Eu- 
clidean space R”, then each tangent plane 7S, to S has an orientation consistent 
with the orientation of S and an inner product induced by the inner product in R”; 
hence there is a volume element §2(x). The k-form (2 that arises on S in this way is 
the volume element on S induced by the embedding of S in R”. 
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Definition 3 The area of an oriented smooth surface is the integral over the surface 
of the volume element corresponding to the orientation chosen for the surface. 


This definition of area, stated in the language of forms and made precise, is of 
course in agreement with Definition | of Sect. 12.4, which we arrived at by consid- 
eration of a smooth k-dimensional surface $ C R” defined in parametric form. 


Proof Indeed, the parametrization orients the surface and all its tangent planes 7S. 
If €,,..., &;, is a frame of a fixed orientation class in TS, it follows from Defini- 
tions 2 and 3 for the volume element @ that 2(x)(&,,...,&;,) > 0. But then (see 
Eq. (12.7) of Sect. 12.4) 


Q(x)(E,,...,&,) = V/det((é;, &;)). (13.17) 


We note that the form (2(x) itself is defined on any set &,,...,&, of vectors in 
TS, but Eq. (13.17) holds only on frames of a given orientation class in TS,. 

We further note that the volume element is defined only on an oriented surface, so 
that it makes no sense, for example, to talk about the volume element on a Mobius 
band in R3, although it does make sense to talk about the volume element of each 
orientable piece of this surface. 


Definition 4 Let S be a k-dimensional piecewise-smooth surface (orientable or not) 
in R”, and Sj,..., S,.-.. a finite or countable number of smooth parametrized 
pieces of it intersecting at most in surfaces of dimension not larger than k — 1 and 
such that S =); Sj. 

The area (or k-dimensional volume) of S is the sum of the areas of the sur- 
faces S;. 

In this sense we can speak of the area of a Mébius band in R? or, what is the 
same, try to find its mass if it is a material surface with matter having unit density. 

The fact that Definition 4 is unambiguous (that the area obtained is independent 
of the partition S;,..., S,,,... of the surface) can be verified by traditional reason- 
ing. 


13.2.4 Expression of the Volume Element in Cartesian Coordinates 


Let S be a smooth hypersurface (of dimension n — 1) in an oriented Euclidean 
space R” endowed with a continuous field of unit normal vectors n(x), x € S, which 
orients it. Let V be the n-dimensional volume in R” and 2 the (n — 1)-dimensional 
volume element on S. 

If we take a frame &,,...,&,_ in the tangent space TS, from the orientation 
class determined by the unit normal n(x) to TS;, we can obviously write the follow- 
ing equality: 


VO), Es ++ En-1) = LODE, En). (13.18) 
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Proof This fact follows from the fact that under the given hypotheses both sides 
are nonnegative and equal in magnitude because the volume of the parallelepiped 
spanned by 7, €),...,&,_, is the area of the base 2(x)(&,,...,&,_1) multiplied 
by the height |7| = 1. 


But, 
Vx)(7, €1,--- €n-1) = 
n! eee 7" 
él ae gt 
Gah «Gs cag 
n ~ 
= So 1)' Tn! (x) de! ee acc ee Gant sb nig (2 ee 
i=1 
Here the variables x!,..., x” are Cartesian coordinates in the orthonormal ba- 
sis €],...,€, that defines the orientation, and the frown over the differential dx’ 


indicates that it is to be omitted. 
Thus we obtain the following coordinate expression for the volume element on 
the oriented hypersurface S Cc R”: 


Q= Soi ty! (x) de! ae ee ee RAR Eis aoce = 4): (13.19) 


i=1 


At this point it is worthwhile to remark that when the orientation of the surface 
is reversed, the direction of the normal 7(x) reverses, that is, the form £2 is replaced 
by the new form —22. 

It follows from the same geometric considerations that for a fixed value of i € 
{Te eusegsft} 


(n(x), €)2(Ey,-- +, &n—1) = VG, € 1,0 En (13.20) 


This last equality means that 


ni (x) 2(x) = (—1)! dx! Armee A ee ase ad (2 pees ae (13.21) 


For a two-dimensional surface S in R” the volume element is most often denoted 
do or dS. These symbols should not be interpreted as the differentials of some forms 
o and S; they are only symbols. If x, y, z are Cartesian coordinates on R°, then in 
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this notation relations (13.19) and (13.21) can be written as follows: 


do = cosa; dy Adz + cosa2 dz A dx + cosa3 dx A dy, 
cosajdo =dy Adz, (oriented areas of the projections 
cosa7zdo =dzAdx, on the coordinate planes). 


cosa3 do = dx A dy, 


Here (cos @1, cos @2, CoS @3)(x) are the direction cosines (coordinates) of the unit 
normal vector n(x) to S at the point x € S. In these equalities (as also in (13.19) and 
(13.21)) it would of course have been more correct to place the restriction sign | on 
the right-hand side so as to avoid misunderstanding. But, in order not to make the 
formulas cumbersome, we confine ourselves to this remark. 


13.2.5 Integrals of First and Second Kind 


Integrals of type (13.12) arise in a number of problems, a typical representative of 
which is the problem considered above of determining the mass of a surface whose 
density is known. These integrals are often called integrals over a surface or integrals 
of first kind. 


Definition 5 The integral of a function p over an oriented surface S is the integral 


[es (13.22) 
S 


of the differential form p92, where §2 is the volume element on S (corresponding to 
the orientation of S chosen in the computation of the integral). 

It is clear that the integral (13.22) so defined is independent of the orientation 
of S, since a reversal of the orientation is accompanied by a corresponding replace- 
ment of the volume element. 

We emphasize that it is not really a matter of integrating a function, but rather 
integrating a form p22 of special type over the surface S with the volume element 
defined on it. 


Definition 6 If S is a piecewise-smooth (orientable or non-orientable) surface and 
p is a function on S, then the integral (13.22) of p over the surface S is the sum 
>; £ S; p& of the integrals of p over the parametrized pieces S),..., Sm,... of the 
partition of S described in Definition 4. 

The integral (13.22) is usually called a surface integral of first kind. 


For example, the integral (13.12), which expresses the mass of the surface S in 
terms of the density ¢ of the mass distribution over the surface, is such an integral. 
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To distinguish integrals of first kind, which are independent of the orientation of 
the surface, we often refer to integrals of forms over an oriented surface as surface 
integrals of second kind. 

We remark that, since all skew-symmetric forms on a vector space whose degrees 
are equal to the dimension of the space are multiples of one another, there is a 
connection w = p82 between any k-form w defined on a k-dimensional orientable 
surface S and the volume element £2 on S. Here p is some function on S depending 


on w. Hence 
[os [ve 
S S 


That is, every integral of second kind can be written as a suitable integral of first 
kind. 


Example 1 The integral (13.2’) of Sect. 13.1, which expresses the work on the path 
y : [a, b] > R”, can be written as the integral of first kind 


[@. e) ds, (13.23) 
Y 


where s is arc length on y, ds is the element of length (a 1-form), and e is a unit 
velocity vector containing all the information about the orientation of y. From the 
point of view of the physical meaning of the problem solved by the integral (13.23), 
it is just as informative as the integral (13.1) of Sect. 13.1. 


Example 2 The flux (13.3) of Sect. 13.1 of the velocity field V across a surface 
S CR’ oriented by unit normals n(x) can be written as the surface integral of first 
kind 


/ (V, n) do. (13.24) 
S 


The information about the orientation of S here is contained in the direction of the 
field of normals n. 


The geometric and physical content of the integrand in (13.24) is just as transpar- 
ent as the corresponding meaning of the integrand in the final computational formula 
(13.6) of Sect. 13.1. 

For the reader’s information we note that quite frequently one encounters the 
notation ds := eds and do := ndo, which introduce a vector element of length and 
a vector element of area. In this notation the integrals (13.23) and (13.24) have the 


form 
/ (F,ds) and i (V,do), 
y S 


which are very convenient from the point of view of physical interpretation. For 
brevity the inner product (A, B) of the vectors A and B is often written A - B. 
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Example 3 Faraday’s law* asserts that the electromotive force arising in a closed 
conductor J” in a variable magnetic field B is proportional to the rate of variation of 
the flux of the magnetic field across a surface S bounded by I”. Let E be the electric 
field intensity. A precise statement of Faraday’s law can be given as the equality 


f b-ds=—2 | Bao. 
r at Js 


The circle in the integration sign over I” is an additional reminder that the integral 
is being taken over a closed curve. The work of the field over a closed curve is 
often called the circulation of the field along this curve. Thus by Faraday’s law 
the circulation of the electric field intensity generated in a closed conductor by a 
variable magnetic field equals the rate of variation of the flux of the magnetic field 
across a surface S bounded by I’, taken with a suitable sign. 


Example 4 Ampére’s law? 


1 
f Beds=—5 j.do 
r é0c" JS 


(where B is the magnetic field intensity, j is the current density vector, and ¢9 and 
c are dimensioning constants) asserts that the circulation of the intensity of a mag- 
netic field generated by an electric current along a contour I” is proportional to the 
strength of the current flowing across the surface S bounded by the contour. 


We have studied integrals of first and second kind. The reader might have no- 
ticed that this terminological distinction is very artificial. In reality we know how to 
integrate, and we do integrate, only differential forms. No integral is ever taken of 
anything else (if the integral is to claim independence of the choice of the coordinate 
system used to compute it). 


13.2.6 Problems and Exercises 


1. Give a formal proof of Eqs. (13.18) and (13.20). 
2. Let y be a smooth curve and ds the element of arc length on y. 


[ roa < | |fo|as 
Y Y 


for any function f on y for which both integrals are defined. 


a) Show that 


4M. Faraday (1791-1867) — outstanding British physicist, creator of the concept of an electromag- 
netic field. 


5A.M. Ampére (1775-1836) — French physicist and mathematician, one of the founders of modern 
electrodynamics. 
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b) Verify that if | f(s)| < M on y and/ is the length of y, then 


i) f(x) ds 
¥ 


c) State and prove assertions analogous to a) and b) in the general case for an 
integral of first kind taken over a k-dimensional smooth surface. 


3. a) Show that the coordinates as ta ia) of the center of masses distributed with 


linear density p(x) along the curve y should be given by the relations 


< Ml. 


x f pords=[ x!pcayas i=1,2,3. 
Y Y 


b) Write the equation of a helix in R? and find the coordinates of the center of 
mass of a piece of this curve, assuming that the mass is distributed along the curve 
with constant density equal to 1. 

c) Exhibit formulas for the center of masses distributed over a surface S with 
surface density p and find the center of masses that are uniformly distributed over 
the surface of a hemisphere. 

d) Exhibit the formulas for the moment of inertia of a mass distributed with 
density p over the surface S. 

e) The tire on a wheel has mass 30 kg and the shape of a torus of outer diameter 
1 m and inner diameter 0.5 m. When the wheel is being balanced, it is placed on 
a balancing lathe and rotated to a velocity corresponding to a speed of the order 
of 100 km/hr, then stopped by brake pads rubbing against a steel disk of diameter 
40 cm and width 2 cm. Estimate the temperature to which the disk would be heated 
if all the kinetic energy of the spinning tire went into heating the disk when the 
wheel was stopped. Assume that the heat capacity of steel is c = 420 J/(kg-K). 


4. a) Show that the gravitational force acting on a point mass mo located at 
(xo, yo, Zo) due to a material curve y having linear density p is given by the for- 
mula 


F=Gmo | rds, 
y Ir? 


where G is the gravitational constant and r is the vector with coordinates (x — 
x0, ¥ — YO, Z— 20). 

b) Write the corresponding formula in the case when the mass is distributed over 
a surface S. 

c) Find the gravitational field of a homogeneous material line. 

d) Find the gravitational field of a homogeneous material sphere. (Exhibit the 
field both outside the ball bounded by the sphere and inside the ball.) 

e) Find the gravitational field created in space by a homogeneous material ball 
(consider both exterior and interior points of the ball). 

f) Regarding the Earth as a liquid ball, find the pressure in it as a function of 
the distance from the center. (The radius of the Earth is 6400 km, and its average 
density is 6 g/cm?.) 
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5. Let y; and y2 be two closed conductors along which currents J; and Jo re- 
spectively are flowing. Let ds, and ds2 be the vector elements of these conductors 
corresponding to the directions of current in them. Let the vector Rj2 be directed 
from ds, to ds2, and Ro; = —Rj2. 

According to the Biot—Savart law® the force dFj2 with which the first element 
acts on the second is 


Ji Jo 


dF }2 = —=—; 
colRi2!? 


[ds2, [ds;, Ria], 


where the brackets denote the vector product of the vectors and co is a dimensioning 
constant. 


a) Show that, on the level of an abstract differential form, it could happen that 
dF }2 ~ —dF>, in the differential Biot-Savart formula, that is, “the reaction is not 
equal and opposite to the action.” 

b) Write the (integral) formulas for the total forces Fj and F>; for the interac- 
tion of the conductors y; and yz and show that F)2 = —F). 


6. The co-area formula (the Kronrod—Federer formula). 

Let M” and N” be smooth surfaces of dimensions m and n respectively, embed- 
ded in a Euclidean space of high dimension (M™ and N” may also be abstract Rie- 
mannian manifolds, but that is not important at the moment). Suppose that m > n. 

Let f : M” — N” be a smooth mapping. When m > n, the mapping df (x) : 
T,M™ — Ty(,)N" has a nonempty kernel kerd f(x). Let us denote by TM" the 
orthogonal complement of kerd f(x), and by J(f, x) the Jacobian of the mapping 
df(x)|riyn: TiM™ — Try N”.Ifm =n, then J(f, x) is the usual Jacobian. 

Let dug (p) denote the volume element on a k-dimensional surface at the point p. 
We shall assume that v9(E) = card E, where vz (E) is the k-volume of E. 


a) Using Fubini’s theorem and the rank theorem (on the local canonical form 
of a smooth mapping) if necessary, prove the following formula of Kronrod and 


Federer: faim J(f, x) dvm(x) = fan Um—n(f—!(y)) dun (y). 
b) Show that if A is a measurable subset of M”, then 


[44.4096 =f n-n(A0. $109) don. 


This is the general Kronrod—Federer formula. 

c) Prove the following strengthening of Sard’s theorem (which in its simplest 
version asserts that the image of the set of critical points of a smooth mapping has 
measure zero). (See Problem 8 of Sect. 11.5.) 

Suppose as before that f : M” — N” is a smooth mapping and K is a compact 
set in M™ on which rank df (x) <n forallx eK. 

Then ee Um—n KN | ae (y)) dun (y) = 0. Use this result to obtain in addition the 
simplest version of Sard’s theorem stated above. 


Biot (1774-1862), Savart (1791-1841) — French physicists. 
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d) Verify that if f : D— R and wu: D— R are smooth functions in a regular 
domain D C R” and u has no critical points in D, then 


[ied al 
v= 2 
D R July” [Vu 


e) Let V(t) be the measure (volume) of the set {x ¢ D | f(x) > ft}, and let the 
function f be nonnegative and bounded in the domain D. 

Show that f), f dv =— fp tdV p(t) = o° Vp(t) de. 

f) Let g e CYR, Ry) and g(0) = 0, while f ¢ C(D,R) and Vip\(t) 
is the measure of the set {x € D | |f(x)| > t}. Verify that Ine o fdu = 
Jo OV f)@ dr. 


13.3. The Fundamental Integral Formulas of Analysis 


The most important formula of analysis is the Newton—Leibniz formula (funda- 
mental theorem of calculus). In the present section we shall obtain the formulas of 
Green, Gauss—Ostrogradskii, and Stokes, which on the one hand are an extension of 
the Newton—Leibniz formula, and on the other hand, taken together, constitute the 
most-used part of the machinery of integral calculus. 

In the first three subsections of this section, without striving for generality in our 
statements, we shall obtain the three classical integral formulas of analysis using 
visualizable material. They will be reduced to one general Stokes formula in the 
fourth subsection, which can be read formally independently of the others. 


13.3.1 Green’s Theorem 


Green’s’ theorem is the following. 


Proposition 1 Let R* be the plane with a fixed coordinate grid x, y, and let D be 
a compact domain in this plane bounded by piecewise-smooth curves. Let P and Q 
be smooth functions in the closed domain D. Then the following relation holds: 


fl (se - J aray= Pdx + Qdy, (13.25) 
D\ ox oy aD 


in which the right-hand side contains the integral over the boundary dD of the 
domain D oriented consistently with the orientation of the domain D itself. 


7G. Green (1793-1841) — British mathematician and mathematical physicist. Newton’s grave in 
Westminster Abbey is framed by five smaller gravestones with brilliant names: Faraday, Thomson 
(Lord Kelvin), Green, Maxwell, and Dirac. 


13.3. The Fundamental Integral Formulas of Analysis 239 


Fig. 13.5 


We shall first consider the simplest version of (13.25) in which D is the square 
T={(@,y)e€ R2 |O<x<1,0<y <1} and Q=0 in J. Then Green’s theorem 


reduces to the equality 
oP 
[[ pew--f P dx, (13.26) 
1 Oy al 


which we shall prove. 


Proof Reducing the double integral to an iterated integral and applying the funda- 
mental theorem of calculus, we obtain 


I aP [ [ aP 
—dxdy= dx —dy= 
D Oy 0 0 Oy 
1 1 1 
= (Pox. 1) = PG.2) dx == f Pox. odr+ f P(x, 1) dx. 
0 0 0 


The proof is now finished. What remains is a matter of definitions and interpre- 
tation of the relation just obtained. The point is that the difference of the last two 
integrals is precisely the right-hand side of relation (13.26). 

Indeed, the piecewise-smooth curve 0/ breaks into four pieces (Fig. 13.5), which 
can be regarded as parametrized curves 


v1 [0,1] > R2, where x + (x, 0), 
y2:[0, 1] > R?, where y Hs (1, y), 


y3: [0,1] > R?, where x Hs (x, 1), 


y4: [0,1] > R?, where ys (0, y). 


By definition of the integral of the 1-form w= P dx over a curve 
1 
/ P(x, y)dx := if vi (P(x, y) dx) := / P(x, 0) dx, 
YI [0,1] 0 


1 
i P(x, y)dx at v3 (P(x, y) dx) = Ody =0, 
y2 [0,1] 0 
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1 
/ P(x, y) dx = v3 (P(x, y) dx) =I P(x, 1) dx, 
¥3 [0,1] 0 
1 
if P(x, y)dx =| v4 (P(x, y) dx) =f Ody =0, 
v4 [0, 1] 0 


and, in addition, by the choice of the orientation of the boundary of the domain, 
taking account of the orientations of 71, y2, 73, v4, it is obvious that 


Le-fetfetfietf e=ferfe-fo-f 
al YI y2 —¥3 —y4 YI y2 ¥3 v4 


where —y; is the curve y; taken with the orientation opposite to the one defined 


by yi. 
Thus Eq. (13.26) is now verified. 


It can be verified similarly that 


[{ aw [ oxy. (13.27) 
ol 


Adding (13.26) and (13.27), we obtain Green’s formula 


[G@-F)«o-f Pdx+ Qdy (13.25’) 
dy al 
for the square /. 


We remark that the asymmetry of P and Q in Green’s formula (13.25) and in 
Eqs. (13.26) and (13.27) comes from the asymmetry of x and y: after all, x and y 
are ordered, and it is that ordering that gives the orientation in R? and in /. 

In the language of forms, the relation (13.25’) just proved can be rewritten as 


feo=] o, (13.25”) 
I ol 


where w is an arbitrary smooth form on J. The integrand on the right-hand side here 
is the restriction of the form @ to the boundary 0/ of the square J. 

The proof of relation (13.26) just given admits an obvious generalization: If Dy is 
not a square, but a “curvilinear quadrilateral” whose lateral sides are vertical closed 
intervals (possibly degenerating to a point) and whose other two sides are the graphs 
of piecewise-smooth functions 9; (x) < ~2(x) over the closed interval [a, b] of the 


x-axis, then 
II Fr ardy=— f Pdx. (13.26’) 
Dy aDy 
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Fig. 13.6 


Similarly, if there is such a “quadrilateral” D, with respect to the y-axis, that is, 
having two horizontal sides, then for it we have the equality 


II 10 ay |. Day (13.27') 
D, 9X aD, 


Now let us assume that the domain D can be cut into a finite number of domains 
of type Dy (Fig. 13.6). Then a formula of the form (13.26) also holds for that 
region D. 


Proof In fact, by additivity, the double integral over the domain D is the sum of 
the integrals over the pieces of type Dy into which D is divided. Formula (13.26’) 
holds for each such piece, that is, the double integral over that piece equals the 
integral of P dx over the oriented boundary of the piece. But adjacent pieces induce 
opposite orientations on their common boundary, so that when the integrals over 
the boundaries are added, all that remains after cancellation is the integral over the 
boundary 4D of the domain D itself. 


Similarly, if D admits a partition into domains of type D,, an equality of type 
(13.27’) holds for it. 

We agree to call domains that can be cut both into pieces of type D, and into 
pieces of type Dy elementary domains. In fact, this class is sufficiently rich for all 
practical applications. 

By writing both relations (13.26’) and (13.27’) for a simple domain, we obtain 
(13.25) by adding them. 

Thus, Green’s theorem is proved for simple domains. 

We shall not undertake any further sharpenings of Green’s formula at this point 
(on this account see Problem 2 below), but rather demonstrate a second, very fruitful 
line of reasoning that one may pursue after establishing Eqs. (13.25’) and (13.25”). 

Suppose the domain C has been obtained by a smooth mapping g : J > C of the 
square I. If w is a smooth 1-form on C, then 


[oo | orao= faoro+ | vom f @. (13.28) 
Cc I r al ac 


The exclamation point here distinguishes the equality we have already proved 
(see (13.25”’)); the extreme terms in these equalities are definitions or direct conse- 
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quences of them; the remaining equality, the second from the left, results from the 
fact that exterior differentiation is independent of the coordinate system. 

Hence Green’s formula also holds for the domain C. 

Finally, if it is possible to cut any oriented domain D into a finite number of 
domains of the same type as C, the considerations already described involving the 
mutual cancellation of the integrals over the portions of the boundaries of the C; 
inside D imply that 


dw = do = = ; 13.29 
ae 


that is, Green’s formula also holds for D. 

It can be shown that every domain with a piecewise-smooth boundary belongs 
to this last class of domains, but we shall not do so, since we shall describe below 
(Chap. 15) a useful technical device that makes it possible to avoid such geometric 
complications, replacing them by an analytic problem that is comparatively easy to 
solve. 

Let us consider some examples of the use of Green’s formula. 


Example I Let us set P = —y, Q = x in (13.25). We then obtain 


/ ~ydrtady= f 2axdy=20(0), 
aD D 


where o (D) is the area of D. Using Green’s formula one can thus obtain the follow- 
ing expression for the area of a domain on the plane in terms of line integrals over 
the oriented boundary of the domain: 


1 
oD) =; | -ydrtxdy=— f yar= [ x dy. 
aD aD aD 


It follows in particular from this that the work A = i P dV performed by a 
heat engine in changing the state of its working substance over a closed cycle y 
equals the area of the domain bounded by the curve y in the PV-plane of states (see 
Problem 5 of Sect. 13.1). 


Example 2 Let B = {(x, y) € R? | x? + y* < 1} be the closed disk in the plane. We 
shall show that any smooth mapping f : B — B of the closed disk into itself has at 
least one fixed point (that is, a point p € B such that f(p) = p). 


Proof Assume that the mapping f has no fixed points. Then for every point p € B 
the ray with initial point f(p) passing through the point p and the point g(p) € 
3B where this ray intersects the circle bounding B are uniquely determined. Thus 
a mapping g : B > 9B would arise, and it is obvious that the restriction of this 
mapping to the boundary would be the identity mapping. Moreover, it would have 
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the same smoothness as the mapping / itself. We shall show that no such mapping 
yg can exist. 
In the domain R7\0 (the plane with the origin omitted) let us consider the form 


aS that we encountered in Sect. 13.1. It can be verified immediately that 


daw = 0. Since dB C R*\0, given the mapping y : B — 0B, one could obtain a form 
y*o on B, and dy*w = y* (dw) = g*0 = 0. Hence by Green’s formula 


/ vw= | dpto=0. 
aB B 


But the restriction of gy to 0B is the identity mapping, and so 


[ eeo= | o. 
aB aB 


This last integral, as was verified in Example | of Sect. 13.1, is nonzero. This con- 
tradiction completes the proof of the assertion. 


oz 


This assertion is of course valid for a ball of any dimension (see Example 5 
below). It also holds not only for smooth mappings, but for all continuous mappings 
f :B—B. In this general form it is called the Brouwer fixed-point theorem.® 


13.3.2 The Gauss—Ostrogradskii Formula 


Just as Green’s formula connects the integral over the boundary of a plane domain 
with a corresponding integral over the domain itself, the Gauss—Ostrogradskii for- 
mula given below connects the integral over the boundary of a three-dimensional 
domain with an integral over the domain itself. 


Proposition 2 Let R* be three-dimensional space with a fixed coordinate system 
x,y,z and D a compact domain in R? bounded by piecewise-smooth surfaces. Let 
P, Q, and R be smooth functions in the closed domain D. 

Then the following relation holds: 


fff 2 +22 +2) acaya 
= — — x = 
p\ox day Oz ae 


= [f_Paynde+ Oden dx + Rar Ady. (13.30) 
aD 


81_E.J. Brouwer (1881-1966) — well-known Dutch mathematician. A number of fundamental the- 
orems of topology are associated with his name, as well as an analysis of the foundations of math- 
ematics that leads to the philosophico-mathematical concepts called intuitionism. 
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Fig. 13.7 z 
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The Gauss—Ostrogradskii formula (13.30) can be derived by repeating the deriva- 
tion of Green’s formula step by step with obvious modifications. So as not to do a 
verbatim repetition, let us begin by considering not a cube in R?, but the domain D, 
shown in Fig. 13.7, which is bounded by a lateral cylindrical surface S with genera- 
tor parallel to the z-axis and two caps S; and Sz which are the eraphs of piecewise- 
smooth functions yg; and g2 defined in the same domain G C R2.,,. We shall verify 
that the relation 


xXy* 


oR 
I ~~ avdyde= ff Rdx Ady (13.31) 
D, 9% aD: 


holds for D-. 


ie s drdyde = 
D, 
(x,y) 
=f avay [" y aR 
g(x,y) ae 
siiveaune-dovandanw 


=~ ff Rs. xe »)avdy + ff R(s »9rte.) dray, 


Proof 


The surfaces S$; and S> have the following parametrizations: 
Si: @,y) > (x,y, gi, y)), 
Sy: (x,y) > (x, y, G2(%, y)). 


The curvilinear coordinates (x, y) define the same orientation on S> that is in- 
duced by the orientation of the domain D-,, and the opposite orientation on Sj. 
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Hence if S; and S> are regarded as pieces of the boundary of D, oriented as in- 
dicated in Proposition 2, these last two integrals can be interpreted as integrals of 
the form R dx A dy over S$; and $2. 

The cylindrical surface S has a parametric representation (t, z) > (x(t), y(@), z), 
so that the restriction of the form Rdx A dy to S equals zero, and so consequently, 
its integral over S is also zero. 

Thus relation (13.31) does indeed hold for the domain D,. 


If the oriented domain D can be cut into a finite number of domains of the 
type D,, then, since adjacent pieces induce opposite orientations on their common 
boundary, the integrals over these pieces will cancel out, leaving only the integral 
over the boundary 0D. 

Consequently, formula (13.31) also holds for domains that admit this kind of 
partition into domains of type D-. 

Similarly, one can introduce domains Dy and D, whose cylindrical surfaces have 
generators parallel to the y-axis or x-axis respectively and show that if a domain D 
can be divided into domains of type Dy or D,, then the relations 


II “S avayae= ff QOdz Adx, (13.32) 
D Oy aD 
oP 
// s—avdyde= ff Pdy Adz. (13.33) 
D Ox aD 


Thus, if D is a simple domain, that is, a domain that admits each of the three 
types of partitions just described into domains of types D,, Dy, and D;, then, by 
adding (13.31), (13.32), and (13.33), we obtain (13.30) for Dz 

For the reasons given in the derivation of Green’s theorem, we shall not undertake 
the description of the conditions for a domain to be simple or any further sharpening 
of what has been proved (in this connection see Problem 8 below or Example 12 in 
Sect. 17.5). 

We note, however, that in the language of forms, the Gauss—Ostrogradskii for- 
mula can be written in coordinate-free form as follows: 


[ew= fo. (13.30) 
D aD 


where w is a smooth 2-form in D. 

Since formula (13.30’) holds for the cube J = I? = {(x, y,z) ER? |0<1<1, 
0< y<1,0<z< 1}, as we have shown, its extension to more general classes of 
domains can of course be carried out using the standard computations (13.28) and 
(13.29). 


Example 3 (The law of Archimedes) Let us compute the buoyant force of a homo- 
geneous liquid on a body D immersed in it. We choose the Cartesian coordinates 
x,y,z in R® so that the xy-plane is the surface of the liquid and the z-axis is di- 
rected out of the liquid. A force pgzndo is acting on an element do of the surface $ 
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of D located at depth z, where p is the density of the liquid, g is the acceleration 


of gravity, and n is a unit outward normal to the surface at the point of the surface 
corresponding to do. Hence the resultant force can be expressed by the integral 


F=f pgzndo. 
Ss 


Ifn = e; cosa, +ey CoSay +e, Cosa, thenndo = e, dy \dz+eydzAdx +e, dx A 
dy (see Sect. 13.2.4). Using the Gauss—Ostrogradskii formula (13.30), we thus find 


that 
F=expe ff say ndz-+eype ff zz ndx-+ecpe ff zor nay = 
=expe [ff odvayae +esps [ff oaray az + 
+ecpe [ff avay z= pave. 


where V is the volume of the body D. Hence P = pgV is the weight of a volume of 
the liquid equal to the volume occupied by the body. We have arrived at Archimedes’ 
law: F= Pe,. 


Example 4 Using the Gauss—Ostrogradskii formula (13.30), one can give the fol- 
lowing formulas for the volume V(D) of a body D bounded by a surface 0D. 


1 
vioy=; |f xdy Adz+ ydzAdx+zdx Ady = 
aD 


-/f xdyAde= ff yd dx = ff zdx Ady. 
aD aD aD 


13.3.3 Stokes’ Formula in R? 


Proposition 3 Let S be an oriented piecewise-smooth compact two-dimensional 
surface with boundary 0S embedded in a domain G C R?, in which a smooth 1- 
form w = P dx + Qdy-+ Rdz is defined. Then the following relation holds: 


aR dO 
Pdx+ Qdy+ Rdz= — — — }dyAdz+ 
as s\d9y dz 
dP AR dO -3F 
_=— \dgAd —~ — — )dx Ady, 
+(F =) : +(3 ~) — 


(13.34) 
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Fig. 13.8 


where the orientation of the boundary 0S is chosen consistently with the orientation 
of the surface S. 
In other notation, this means that 


[ew=| o. (13.34) 
Ss do 


Proof If C is a standard parametrized surface y : J > C in R?, where J is a square 
in R?, relation (13.34) follows from Eqs. (13.28) taking account of what has been 
proved for the square and Green’s formula. 

If the orientable surface S can be cut into elementary surfaces of this type, then 
relation (13.34) is also valid for it, as follows from Eqs. (13.29) with D replaced 
by S. 


As in the preceding cases, we shall not prove at this point that, for example, a 
piecewise-smooth surface admits such a partition. 

Let us show what this proof of formula (13.34) would look like in coordinate 
notation. To avoid expressions that are really too cumbersome, we shall write out 
only the first, main part of its two expressions, and with some simplifications even 
in that. To be specific, let us introduce the notation x!, x2, x3 for the coordinates of 


a point x € R? and verify only that 


aP aP 
/ Pods! = ff 2 dx? ade! + dx? nds, 
as 5 0x2 ax 


since the other two terms on the left-hand side of (13.34) can be studied similarly. 
For simplicity we shall assume that S can be obtained by a smooth mapping x = x(t) 
of a domain D in the plane R? of the variables t!, t? and bounded by a smooth curve 
y = 0D parametrized via a mapping t = ¢(t) by the points of the closed interval 
a <t <6 (Fig. 13.8). Then the boundary I” = 0S of the surface S can be written as 
x =x(t(t)), where t ranges over the closed interval [a#, 6]. Using the definition of 
the integral over a curve, Green’s formula for a plane domain D, and the definition 
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of the integral over a parametrized surface, we find successively 


P dz) di) Ox! de? 
P d. Te P t dr = 
A vs [ at ©) (F ey x) . 
2 [ (? (eo) re +(? (en) eS =a 
<ff\s : pe dt! A de? = 
ar! PS ar2\ ar! 7 
dP ax! aP ax Ps a8 
=fhG t! ar? ar? a) a eS 
3 : . 
_ I ae oy a aP a a Ae 
fs eee ox! ot’ dt ox! ot Ot 


- ff OP ax? , ap ax? \ ax! 
ax? dr! Faas at! } ar? 


dP dx? AP dx3\ dx! 
2 
2 972 3972 I ~ 
Ox- Ot Ox? Ot ot dt! A dt 
2 2 3 3 
OP Ge aes SP at ae| bad <8 
= Salat al ae la ,| | dt Adt = 
Dp \ Ox | ax_ ax Ox? | ax Ox” 
ant ar? at at 


oP 
= |[(Fae A dx rer ax ndx!). 


The colon here denotes equality by definition, and the exclamation point denotes 
a transition that uses the Green’s formula already proved. The rest consists of iden- 
tities. 

Using the basic idea of the proof of formula (13.34’), we have thus verified 
directly (without invoking the relation y* d = dg*, but essentially proving it for 
the case under consideration) that formula (13.34) does indeed hold for a simple 
parametrized surface. We have carried out the reasoning formally only for the term 
P dx, but it is clear that the same thing could also be done for the other two terms 
in the 1-form in the integrand on the left-hand side of (13.34). 


13.3.4 The General Stokes Formula 


Despite the differences in the external appearance of formulas (13.25), (13.30), and 
(13.34), their coordinate-free expressions (13.25), (13.29), (13.30’), and (13.34’) 
turn out to be identical. This gives grounds for supposing that we have been dealing 
with particular manifestations of a general rule, which one can now easily guess. 
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Proposition 4 Let S be an oriented piecewise smooth k-dimensional compact sur- 
face with boundary 0S in the domain G C R", in which a smooth (k — 1)-form w is 
defined. 

Then the following relation holds: 


[ew=| o, (13.35) 
Ss as 


in which the orientation of the boundary 0S is that induced by the orientation of S. 


Proof Formula (13.35) can obviously be proved by the same general computations 
(13.28) and (13.29) as Stokes’ formula (13.34’) provided it holds for a standard k- 
dimensional interval [* = {x = (x!,...,x*) eR‘ |O< x! <1,i=1,...,k}. Letus 
verify that (13.35) does indeed hold for J J 


Since a (k — 1)-form on J* has the form w = yo; 4 (x) dx! AsxAds! Av Ads* 
(summation over i = 1,...,k, with the differential dx’ omitted), it suffices to prove 


(13.35) for each individual term. Let @ = a(x)dx! A-+- A dx! A+++ A dx*. Then 
dw = (—1)'7! Je (x) dx! A---Adxi A---Adx*. We now carry out the computation: 


10 
[=] pi “wade a---vdet = 
Tk Ik ox! 
S 1 
a 
-cyf det veda! -sedet f ©? wax! = 
[k-1 0 Ox! 
=f (Ae oa ea ea ys 
[k-1 
Sig(s assy OA ack”) de ole td = 
=f Oe dei LG cera" ae ed 
[k-1 


+1 f (A(t NOt A dete dk), 
ee 


Here /*—! is the same as /* in R‘, only it is a (k — 1)-dimensional interval in 


R*—!. In addition, we have relabeled the variables x! =1!,.. . xi! =fitl xitha 
ti eae 
The mappings 
Pe st avast Si (Oe I eed” ST, 
Psrta(,..A re (108, A) er 


are parametrizations of the upper and lower faces J}; and Ijo of the interval J k 
respectively orthogonal to the x’ axis. These coordinates define the same frame 
€1,...,@;-1, 741, .--, eg orienting the faces and differing from the frame ej, ..., ex 
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of IR* in the absence of e;. On I, the vector e; is the exterior normal to /*, as the 
vector —e; is for the face jo. The frame e;, e1,..., €;—1, €j41,---, ex becomes the 
frame e;,..., ex after i — 1 inter-changes of adjacent vectors, that is, the agreement 
or disagreement of the orientations of these frames is determined by the sign of 
(-1)'7!. Thus, this parametrization defines an orientation on J}; consistent with 
the orientation of 7* if taken with the corrective coefficient (—1)‘—! (that is, not 
changing the orientation when i is odd, but changing it when 7 is even). 

Analogous reasoning shows that for the face Io it is necessary to take a correc- 
tive coefficient (—1)! to the orientation defined by this parametrization of the face 
Tio. 

Thus, the last two integrals (together with the coefficients in front of them) can 
be interpreted respectively as the integrals of the form @ over the faces I and Io 
of I* with the orientation induced by the orientation of I*. 

We now remark that on each of the remaining faces of I* one of the coordinates 
ee ee a x* is constant. Hence the differential corresponding to it is 
equal to zero on such a face. Thus, the form dw is identically equal to zero and its 
integral equals zero over all faces except Io and Ij. 

Hence we can interpret the sum of the integrals over these two faces as the in- 
tegral of the form @ over the entire boundary 3/* of the interval /* oriented in 
consistency with the orientation of the interval J* itself. 


The formula 
; da = / QO, 
Tk ark 


and along with it formula (13.35), is now proved. 


As one can see, formula (13.35) is a corollary of the Newton—Leibniz formula 
(fundamental theorem of calculus), Fubini’s theorem, and a series of definitions 
of such concepts as surface, boundary of a surface, orientation, differential form, 
differentiation of a differential form, and transference of forms. 

Formulas (13.25), (13.30), and (13.34), the formulas of Green, Gauss— 
Ostrogradskii, and Stokes respectively, are special cases of the general formula 
(13.35). Moreover, if we interpret a function f defined on a closed interval 
[a,b] C Ras a 0-form w, and the integral of a 0-form over an oriented point as the 
value of the function at that point taken with the sign of the orientation of the point, 
then the Newton—Leibniz formula itself can be regarded as an elementary (but inde- 
pendent) version of (13.35). Consequently, the fundamental relation (13.35) holds 
in all dimensions k > 1. 

Formula (13.35) is often called the general Stokes formula. As historical infor- 
mation, we quote here some lines from the preface of M. Spivak to his book (cited 
in the bibliography below): 

The first statement of the Theorem? appears as a postscript to a letter, dated July 2, 1850, 

from Sir William Thomson (Lord Kelvin) to Stokes. It appeared publicly as question 8 on 


°The classical Stokes theorem (13.34) is meant. 
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the Smith’s Prize Examination for 1854. This competitive examination, which was taken an- 
nually by the best mathematics students at Cambridge University, was set from 1849 to 1882 
by Professor Stokes; by the time of his death the result was known universally as Stokes’ 
theorem. At least three proofs were given by his contemporaries: Thomson published one, 
another appeared in Thomson and Tait’s Treatise on Natural Philosophy, and Maxwell pro- 
vided another in Electricity and Magnetism. Since this time the name of Stokes has been 
applied to much more general results, which have figured so prominently in the develop- 
ment of certain parts of mathematics that Stokes’ theorem may be considered a case study 
in the value of generalization. 


We note that the modern language of differential forms originates with Elie Car- 
tan,!° but the form (13.35) for the general Stokes’ formula for surfaces in R” seems 
to have been first proposed by Poincaré. For domains in n-dimensional space R” Os- 
trogradskii already knew the formula, and Leibniz wrote down the first differential 
forms. 

Thus it is not an accident that the general Stokes formula (13.35) is sometimes 
called the Newton—Leibniz—Green—Gauss—Ostrogradskii—Stokes Poincaré formula. 
One can conclude from what has been said that this is by no means its full name. 

Let us use this formula to generalize the result of Example 2. 


Example 5 Let us show that every smooth mapping f : B — B of a closed ball 
B CR’ into itself has at least one fixed point. 


Proof If the mapping f had no fixed points, then, as in Example 2, one could con- 
struct a smooth mapping g: B — 0B that is the identity on the sphere 0B. In the 


domain R”\0, we consider the vector field WW where r is the radius-vector of the 


point x = (xt, xe R”\0, and the flux form 


r my (—1)' 1x! dx! A+++ Adal A>-+ A dx™ 
=i “ie GP MarG yy 
corresponding to this field (see formula (13.19) of Sect. 13.2). The flux of such a 
field across the boundary of the ball B = {x € R| |x| = 1} in the direction of the 
outward normal to the sphere 2B is obviously equal to the area of the sphere 0B, 
that is, f, jp © # O. But, as one can easily verify by direct computation, dw = 0 in 
IR” \0, from which, by using the general Stokes formula, as in Example 2, we find 


that 
} o= | v= | dptw= | o*ao= | go=0. 
aB aB B B B 


This contradiction finishes the proof. 


\0Blie Cartan (1869-1951) — outstanding French geometer. 
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13.3.5 Problems and Exercises 


1. a) Does Green’s formula (13.25) change if we pass from the coordinate system 
x, y to the system y, x? 

b) Does formula (13.25”) change in this case? 
2. a) Prove that formula (13.25) remains valid if the functions P and Q are con- 
tinuous in a closed square /, their partial derivatives oe and a@ are continuous 
at interior points of 7, and the double integrals exist, even if as improper integrals 
(13.25’). 

b) Verify that if the boundary of a compact domain D consists of piecewise- 
smooth curves, then under assumptions analogous to those in a), formula (13.25) 
remains valid. 


3. a) Verify the proof of (13.26’) in detail. 

b) Show that if the boundary of a compact domain D C R? consists of a finite 
number of smooth curves having only a finite number of points of inflection, then 
D is a simple domain with respect to any pair of coordinate axes. 

c) Is it true that if the boundary of a plane domain consists of smooth curves, 
then one can choose the coordinate axes in R? such that it is a simple domain relative 
to them? 


4. a) Show that if the functions P and Q in Green’s formula are such that 
sO _ a = |, then the area o(D) of the domain D can be found using the for- 
mula o(D) = f,,, Pdx + Ody. 

b) Explain the geometric meaning of the integral / Pe dx over some (possibly 
nonclosed) curve in the plane with Cartesian coordinates x, y. Starting from this, 
give a new interpretation of the formula 0 (D) = — /, ap y dx. 


c) As acheck on the preceding formula, use it to find the area of the domain 


x2 2 
p={oer| 543 <1], 


5. a) Let x = x(t) be a diffeomorphism of the domain D; C R? onto the domain 


Dy Cc R?. Using the results of Problem 4 and the fact that a line integral is indepen- 
dent of the admissible change in the parametrization of the path, prove that 


/ av= | |x’ (t)| dr, 
Dy D; 


where dx = dx! dx?, dt = dr! dr?, |x’ (t)| = detx’(t). 
b) From a) derive the formula 


[ teae | Ff (x(t) |det x’(t)| de 
Dy D, 


for change of variable in a double integral. 
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6. Let f(x, y,t) be a smooth function satisfying the condition (zy + (zy #0 
in its domain of definition. Then for each fixed value of the parameter t the equation 
f(x, y,t) =0 defines a curve y; in the plane R?. Then a family of curves {y;} 
depending on the parameter f arises in the plane. A smooth curve I’ C R? defined 
by parametric equations x = x(t), y = y(f), is the envelope of the family of curves 
{v} if the point x(fo), y(to) lies on the corresponding curve y;, and the curves I” 
and y;. are tangent at that point, for every value of fo in the common domain of 
definition of {y;} and the functions x(t), y(¢). 


a) Assuming that x, y are Cartesian coordinates in the plane, show that the func- 
tions x(t), y(t) that define the envelope must satisfy the system of equations 


f(x, y,t) =0, 
a 
“F(x, y,1)=0, 


and from the geometric point of view the envelope itself is the boundary of the 
projection (shadow) of the surface f(x, y, ft) =0 of Ri. y,t) 00 the plane Ry. y)" 

b) A family of lines x cosa + ysina — p(a) = 0 is given in the plane with 
Cartesian coordinates x and y. The role of the parameter is played here by the polar 
angle a. Give the geometric meaning of the quantity p(@), and find the envelope of 
this family if p(@) =c + acosa + bsina, where a, b, and c are constants. 

c) Describe the accessible zone of a shell that can be fired from an adjustable 
cannon making any angle a € [0, 2/2] to the horizon. 

d) Show that if the function p(a) of b) is 27r-periodic, then the corresponding 
envelope I" is a closed curve. 

e) Using Problem 4, show that the length L of the closed curve I” obtained in d) 
can be found by the formula 

20 
L= / p(a) da. 
0 


(Assume that p € C®).) 
f) Show also that the area o of the region bounded by the closed curve I” ob- 
tained in d) can be computed as 


20 d 
c= =f (p> _ Pp’) (a) dev, p(a) = 5p): 


7. Consider the integral i sos(rsn) ds, in which y is a smooth curve in R?, r is the 


radius-vector of the point (x, y) € y,r = |r| = x2 + y?, mis the unit normal vector 
to y at (x, y) varying continuously along y, and ds is arc length on the curve. This 
integral is called Gauss’ integral. 


a) Write Gauss’ integral in the form of a flux L (V,n) ds of the plane vector 
field V across the curve y. 
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b) Show that in Cartesian coordinates x and y Gauss’ integral has the form 
+ de — ee familiar to us from Example | of Sect. 13.1, where the choice of 
sign is determined by the choice of the field of normals n. 

c) Compute Gauss’ integral for a closed curve y that encircles the origin once 
and for a curve y bounding a domain that does not contain the origin. 

d) Show that oes ds = dg, where ¢ is the polar angle of the radius-vector r, 
and give the geometric meaning of the value of Gauss’ integral for a closed curve 
and for an arbitrary curve y C R?. 


8. In deriving the Gauss—Ostrogradskii formula we assumed that D is a simple do- 
main and the functions P, Q, R belong to C“!) (D, R). Show by improving the rea- 
soning that formula (13.30) holds if D is a compact domain with piecewise smooth 
boundary, P,Q, REC (D,R), oP ; go ae € C(D, R), and the triple integral con- 
verges, even if it is an improper integral. 

9. a) If the functions P, Q, and R in formula (13.30) are such that 9° Pt se c+ ee = 


1, then the volume V (D) of the domain D can be found by the fonia’ 
viv) = ff PdyAdz+ QdzAdx+Rdx Ady. 
aD 


b) Let f(x, t) be smooth function of the variables x ¢ Dy C RY, t ¢ D; CR? 
and af — — a2 es of ry # 0. Write the system of equations that must be satisfied by 
the (n — 1)-dimensional surface in RR? that is the envelope of the family of surfaces 
{S;} defined by the conditions f(x, t) =0, t € D; (see Problem 6). 


c) Choosing a point on the unit sphere as the parameter f, exhibit a family of 


ana in R? depending on the parameter t whose envelope is the ellipsoid 7 + 


y? 
+521. 

Be! 
d) “Show that if a closed surface S is the envelope of a family of planes 


cos a)(t)x + cosa(t)y + cosa3(t)z — p(t) =0 


where a, @2, a3 are the angles formed by the normal to the plane and the coordinate 
axes and the parameter f is a variable point of the unit sphere S* C R?, then the area 
o of the surface S can be found by the formula o = gs P(t) do. 

e) Show that the volume of the body bounded by the surface S considered in d) 
can be found by the formula V = 5 fs p(t)do. 


f) Test the formula given in e) by finding the volume of the ellipsoid xs + oy + 
a <1. 
g) What does the n-dimensional analogue of the formulas in d) and e) look like? 


10. a) Using the Gauss—Ostrogradskii formula, verify that the flux of the field r/r? 
(where r is the radius-vector of the point x € R? and r = |r|) across a smooth surface 
S enclosing the origin and homeomorphic to a sphere equals the flux of the same 
field across an arbitrarily small sphere |x| = e. 

b) Show that the flux in a) is 47. 
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c) Interpret Gauss’ integral s sos(rsn) ds in R? as the flux of the field r/r? 
across the surface S. 

d) Compute Gauss’ integral over the boundary of a compact domain D C R?, 
considering both the case when D contains the origin in its interior and the case 
when the origin lies outside D. 

e) Comparing Problems 7 and 10a)-d), give an n-dimensional version of 
Gauss’ integral and the corresponding vector field. Give an n-dimensional statement 
of problems a)—d) and verify it. 


11. a) Show that a closed rigid surface § C R? remains in equilibrium under the 
action of a uniformly distributed pressure on it. (By the principles of statics the 
problem reduces to verifying the equalities f/,ndo = 0, //,[r,n]do =0, where n 
is a unit normal vector, r is the radius-vector, and [r, n] is the vector product of r 
and n.) 

b) A solid body of volume V is completely immersed in a liquid having spe- 
cific gravity 1. Show that the complete static effect of the pressure of the liquid on 
the body reduces to a single force F of magnitude V directed vertically upward and 
attached to the center of mass C of the solid domain occupied by the body. 


12. Let 7: I + D be a smooth (not necessarily homeomorphic) mapping of an 
interval J* Cc R* into a domain D of R”, in which a k-form @ is defined. By analogy 
with the one-dimensional case, we shall call a mapping I" a k-cell or k-path and by 
definition set po= if yk *a. Study the proof of the general Stokes formula and 
verify that it holds not only for k-dimensional surfaces but also for k-cells. 

13. Using the generalized Stokes formula, prove by induction the formula for 
change of variable in a multiple integral (the idea of the proof is shown in Prob- 
lem 5a)). 

14. Integration by parts in a multiple integral. 

Let D be a bounded domain in R” with a regular (smooth or piecewise smooth) 
boundary 4D oriented by the outward unit normal n= (n!,...,n'). 

Let f, g be smooth functions in D. 


[atev= [pri ao. 


b) Prove the following formula for integration by parts: 


: pedo / fen! do — / Fig) dv. 
D aD D 


a) Show that 


Chapter 14 
Elements of Vector Analysis and Field Theory 


14.1 The Differential Operations of Vector Analysis 


14.1.1 Scalar and Vector Fields 


In field theory we consider functions x ++ T(x) that assign to each point x of a 
given domain D a special object T (x) called a tensor. If such a function is defined 
in a domain D, we say that a tensor field is defined in D. We do not intend to give 
the definition of a tensor at this point: that concept will be studied in algebra and 
differential geometry. We shall say only that numerical functions D3 xt f(x) € 
R and vector-valued functions R” > D3 xt> V(x) € TR! © R" are special cases 
of tensor fields and are called scalar fields and vector fields respectively in D (we 
have used this terminology earlier). 

A differential p-form @ in D is a function R” D D3 xR w(x) € L((R")?, R) 
which can be called a field of forms of degree p in D. This also is a special case of 
a tensor field. 

At present we are primarily interested in scalar and vector fields in domains of 
the oriented Euclidean space R”. These fields play a major role in many applications 
of analysis in natural science. 


14.1.2 Vector Fields and Forms in R3 


We recall that in the Euclidean vector space R* with inner product (, ) there is a 
correspondence between linear functionals A : R? —> R and vectors A € R? consist- 
ing of the following: Each such functional has the form A(&) = (A, &), where A is 
a completely definite vector in R?. 

If the space is also oriented, each skew-symmetric bilinear functional B: R? x 
IR? — R can be uniquely written in the form B(é,, &>) = (B, €;, €>), where B is 
a completely definite vector in R? and (B, €,, >), as always, is the scalar triple 
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product of the vectors B, &,, and &,, or what is the same, the value of the volume 
element on these vectors. Thus, in the oriented Euclidean vector space R* one can 
associate with each vector a linear or bilinear form, and defining the linear or bilinear 
form is equivalent to defining the corresponding vector in R?. 

If there is an inner product in R?, it also arises naturally in each tangent space 
TR? consisting of the vectors attached to the point R°, and the orientation of R? 
orients each space TR}. 

Hence defining a 1-form w!(x) or a 2-form w*(x) in TR} under the conditions 
just listed is equivalent to defining some vector A(x) € TR} corresponding to the 
form w! (x) or a vector B(x) € TR} corresponding to the form w*(x). 

Consequently, defining a 1-form w! or a 2-form w* in a domain D of the ori- 
ented Euclidean space R? is equivalent to defining the vector field A or B in D 
corresponding to the form. 

In explicit form, this correspondence amounts to the following: 


wa (x)(&) = (A(x), &), (14.1) 
op (x)(E 1, &9) = (B(x), &, 9), (14.2) 


where A(x), B(x), &, &;, and &, belong to TD,. 
Here we see the work form w! = ve of the vector field A and the flux form 
w= OR of the vector field B, which are already familiar to us. 


To ascalar field f : D — R, we can assign a 0-form and a 3-form in D as follows: 
oy =f, (14.3) 
oF = fdv, (14.4) 


where dV is the volume element in the oriented Euclidean space R?. 

In view of the correspondences (14.1)—(14.4), definite operations on vector and 
scalar fields correspond to operations on forms. This observation, as we shall soon 
verify, is very useful technically. 


Proposition 1 To a linear combination of forms of the same degree there corre- 
sponds a linear combination of the vector and scalar fields corresponding to them. 


Proof Proposition | is of course obvious. However, let us write out the full proof, 
as an example, for |-forms: 


aon, +0n@,, = 01 (AL, -) + a(Ad,+) = 


2 
— (a, Ay + a7 Ad, +) = a, Ay+o2A2* 


It is clear from the proof that ~; and a2 can be regarded as functions (not neces- 
sarily constant) in the domain D in which the forms and fields are defined. 

As an abbreviation, let us agree to use, along with the symbols (, ) and [, ] for 
the inner product and the vector product of vectors A and B in R?, the alternative 
notation A - B and A x B wherever convenient. 
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Proposition 2 Jf A, B, A,, and B, are vector fields in the oriented Euclidean 
space R?3, then 

M4, AWA, =A, x Ay» (14.5) 

Oh, AOL =O». (14.6) 

In other words, the vector product A; x Ag of fields A; and A» that generate 

1-forms corresponds to the exterior product of the 1-forms they generate, since it 


generates the 2-form that results from the product. 


In the same sense the inner product of the vector fields A and B that generate a 


1-form ON and a 2-form OR corresponds to the exterior product of these forms. 


Proof To prove these assertions, fix an orthonormal basis in R? and the Cartesian 


coordinates x!, x2, x3 corresponding to it. 


In Cartesian coordinates 


3 3 
on (x)(E) = A(x) -€ = D0 AN(x)E! = DOAN (x) dx‘), 


i=1 i=l 
that is, 
wo, = Al dx! + A? dx? + A? dx, (14.7) 
and 
Blix) Bt(x) B(x) 
o@ME. =| & &  & f= 
& & &} 

= (B'(x)dx? A dx? + B? dx? Adx! + BP(x) dx! A dx’) (E,, &9), 
that is, 

wos = B' dx” A dx? + B? dx? Adx! + Be dx! A dx’. (14.8) 


Therefore in Cartesian coordinates, taking account of expressions (14.7) and 
(14.8), we obtain 


wa, A@a, = (Aj dx! + Aj dx? + Aj dx*) A (A5 dx! + A5dx? + A} dx*) = 
= (A{A3 — A} A3) dx? A dx? + (A3A} — Aj A3) dx? A dx! + 
+ (Aj A5 — ATA3) dx! A dx? = 
2 


= Op, 


where B = Ay x Ao. 
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Coordinates were used in this proof only to make it easier to find the vector B 
of the corresponding 2-form. The equality (14.5) itself, of course, is independent of 
the coordinate system. 

Similarly, multiplying Eqs. (14.7) and (14.8), we obtain 

wo AOR = (A'B! AWB? 4: A? B?) dx! A dx? A dx? = ow. 

In Cartesian coordinates dx! A dx? A dx? is the volume element in R?, and the 
sum of the pairwise products of the coordinates of the vectors A and B, which 
appears in parentheses just before the 3-form, is the inner product of these vectors 


at the corresponding points of the domain, from which it follows that p(x) = A(x) - 
B(x). 


14.1.3 The Differential Operators grad, curl, div, and V 


Definition 1 To the exterior differentiation of 0-forms (functions), 1-forms, and 2- 
forms in oriented Euclidean space R? there correspond respectively the operations 
of finding the gradient (grad) of a scalar field and the curl and divergence (div) of 
a vector field. These operations are defined by the relations 


deo =: Ograd f> (14.9) 
dak =: @2 aa> (14.10) 
dog =! OF, p- (14.11) 


By virtue of the correspondence between forms and scalar and vector fields in R? 
established by Eqs. (14.1)-(14.4), relations (14.9)-(14.11) are unambiguous defini- 
tions of the operations grad, curl, and div, performed on scalar and vector fields 
respectively. These operations, the operators of field theory as they are called, cor- 
respond to the single operation of exterior differentiation of forms, but applied to 
forms of different degree. 

Let us give right away the explicit form of these operators in Cartesian coordi- 
nates x!, x2, x3 in R?. 

As we have explained, in this case 


o-=f (14.3’) 

wh = Al dx! + A? dx? + A? dx}, (14.7') 

wp = B! dx? A dx? + B? dx? A dx! + BP dx! A dx’, (14.8') 

A= pdx Ade Ade. (14.4’) 
Since 

oh 7 = do = af = 25 ax! + FF ay? + 2F ax, 


ax? ax3 
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it follows from (14.7’) that in these coordinates 


af of 


; 14.9’ 
tex, a t+@a 3 (14.9') 


af 
d = 
grad f =e el 


where e€1, €2, €3 is a fixed orthonormal basis of R. 
Since 


Oust A = dao, = d(A! dx! + A?dx? + A? dx?) = 


aA> aA? aA! 9aA3 
= (Fo - B)ar aac+( = SA) nas! + 


ax2 ax ax> ax! 
g@A° OAY\ 4g. 
+ (— = =] dx A dx’, 


it follows from (14.8’) that in Cartesian coordinates 
aA% aA? dA! aA? aA” aA! 
1A=e,{ — - — e| — - = e3{ —_ - —~ }]. 14.10’ 
oo (FZ a) + (Fo ar) + (Fa =) ( ) 
As an aid to memory this last relation is often written in symbolic form as 


e] e2 &3 


culA=|54r ga Sl. (14.10”) 


Ai A? <A} 


Next, since 


is = dog = d(B! dx? A dx? + B? dx? A dx! + B* dx! A dx?) = 


OB OB? OR \ 4 4. aA 
= (= 9x2 at) ae A dx* A dx”, 


it follows from (14.4) that in Cartesian coordinates 


dB! 0B? aB ; 
divB = axl + ax? + aS (14.11’) 

One can see from the formulas (14.9’), (14.10’), and (14.11’) just obtained that 
grad, curl, and div are linear differential operations (operators). The grad operator 
is defined on differentiable scalar fields and assigns vector fields to the scalar fields. 
The curl operator is also vector-valued, but is defined on differentiable vector fields. 
The div operator is defined on differentiable vector fields and assigns scalar fields 
to them. 

We note that in other coordinates these operators will have expressions that are 
in general different from those obtained above in Cartesian coordinates. We shall 
discuss this point in Sect. 14.1.5 below. 

We remark also that the vector field curl A is sometimes called the rotation of A 
and written rot A. 
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As an example of the use of these operators we write out the famous! system of 
equations of Maxwell,” which describe the state of the components of an electro- 
magnetic field as functions of a point x = (x!, x7, x) in space and time f. 


Example I (The Maxwell equations for an electromagnetic field in a vacuum) 


Lady. 2. divB=0. 
€0 

- , . Lai (14.12) 

3. ala 4. curlB = —~ + — —. 


Here p(x, t) is the electric charge density (the quantity of charge per unit vol- 
ume), j(x,f) is the electrical current density vector (the rate at which charge is 
flowing across a unit area), E(x, t) and B(x, f) are the electric and magnetic field 
intensities respectively, and ¢9 and c are dimensioning constants (and in fact c is the 
speed of light in a vacuum). 


In mathematical and especially in physical literature, along with the operators 
grad, curl, and div, wide use is made of the symbolic differential operator nabla 
proposed by Hamilton (the Hamilton operator) 


e Da se u 
Yael 2 


v= 
ax2 | ax3 


(14.13) 


where {e1, €2, e3} is an orthonormal basis of R? and x!, x2, x3 are the corresponding 
Cartesian coordinates. 

By definition, applying the operator V to a scalar field f (that is, to a function), 
gives the vector field 


af F) af 
Vf= a 
f=e al +e) ax2 +e ax 


which coincides with the field (14.9’), that is, the nabla operator is simply the grad 
operator written in a different notation. 


'On this subject the famous American physicist and mathematician R. Feynman (1918-1988) 
writes, with his characteristic acerbity, “From a long view of the history of mankind — seen from, 
say, ten thousand years from now — there can be little doubt that the most significant event of the 
19th century will be judged as Maxwell’s discovery of the laws of electrodynamics. The American 
Civil War will pale into provincial insignificance in comparison with this important scientific event 
of the same decade.” Richard R. Feynman, Robert B. Leighton, and Matthew Sands, The Feynman 
Lectures on Physics: Mainly Electromagnetism and Matter, Addison-Wesley, Reading, MA, 1964. 


2J.C. Maxwell (1831-1879) — outstanding Scottish physicist; he created the mathematical theory 
of the electromagnetic field and is also famous for his research in the kinetic theory of gases, optics 
and mechanics. 


3W.R. Hamilton (1805-1865) — famous Irish mathematician and specialist in mechanics; he stated 
the variational principle (Hamilton’s principle) and constructed a phenomenological theory of optic 
phenomena; he was the creator of the theory of quaternions and the founder of vector analysis (in 
fact, the term “vector” is due to him). 
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Using, however, the vector form in which V is written, Hamilton proposed a sys- 
tem of formal operations with it that imitates the corresponding algebraic operations 
with vectors. 

Before we illustrate these operations, we note that in dealing with V one must 
adhere to the same principles and cautionary rules as in dealing with the usual 
differentiation operator D = £. For example, gDf equals ost and not £@ f) 


or f e Thus, the operator operates on whatever is placed to the right of it; left 
multiplication in this case plays the role of a coefficient, that is, gD is the new 
differential operator oe, not the function a Moreover, D? = D - D, that is, 
Df =D(Df) = 2(4 f= Sf. 

If we now, following Hamilton, deal with V as if it were a vector field defined 
in Cartesian coordinates, then, comparing relations (14.13), (14.9’), (14.10”), and 
(14.11’), we obtain 


grad f = Vf, (14.14) 
curlA = V x A, (14.15) 
divB=V-B. (14.16) 


In this way the operators grad, curl, and div, can be written in terms of the Hamil- 
ton operator and the vector operations in R?. 


Example 2 Only the curl and div operators occurred in writing out the Maxwell 
equations (14.12). Using the principles for dealing with V = grad, we rewrite the 
Maxwell equations as follows, to compensate for the absence of grad in them: 


1LV-E=. 2.V-B=0. 
£0 
(14.12') 


oB 
3,.VxE=-—. 4.VxB= 
ot Eoc 


14.1.4 Some Differential Formulas of Vector Analysis 


In the oriented Euclidean space R? we have established the connection (14.1)-(14.4) 
between forms on the one hand and vector and scalar fields on the other. This con- 
nection enabled us to associate corresponding operators on fields with exterior dif- 
ferentiation (see formulas (14.5), (14.6), and (14.9)-(14.11)). 

This correspondence can be used to obtain a number of basic differential formu- 
las of vector analysis. 

For example, the following relations hold: 


curl( fA) = f curlA — A x grad f, (14.17) 
div( fA) =A- grad f + fdivA, (14.18) 
div(A x B) =B.-curlA — A-curlB. (14.19) 
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Proof We shall verify this last equality: 
3 2 1 i 1 1 1 1 
div AxB = IAB = (4 A OB) = dog AOR — Og A dog = 


_ 2 1 1 DS ouch 3 33 
= Wound BR — a 6 GounB = ©B-curlA ~ CA-curlB = ©B-curl A—A-curl B* 


The first two relations are verified similarly. Of course, the verification of all 
these equalities can also be carried out by direct differentiation in coordinates. 


If we take account of the relation d?@ = 0 for any form w, we can also assert that 
the following equalities hold: 


curl grad f = 0, (14.20) 
div curl A = 0. (14.21) 


Proof Indeed: 


2 _ 1 = 0\ _ 42 - 
curl grad f —_ do grad f = d(dw;) =d We => 0, 


k — Ay? = 1) _ g2,.1 _ 
div curl A dees = dda) =d On = 0. 


In formulas (14.17)-(14.19) the operators grad, curl, and div are applied once, 
while (14.20) and (14.21) involve the second-order operators obtained by successive 
execution of two of the three original operations. Besides the rules given in (14.20) 
and (14.21), one can also consider other combinations of these operators: 


graddivA, curlcurlA, divgrad f. (14.22) 


The operator div grad is applied, as one can see, to a scalar field. This operator is 
denoted A (Delta) and is called the Laplace operator* or Laplacian. 
It follows from (14.9’) and (14.11’) that in Cartesian coordinates 


_ OF a f a f 
_ a(x!)2 + a(x2)2 =e 0(x3)2° 


Af (14.23) 


Since the operator A acts on numerical functions, it can be applied component- 
wise to the coordinates of vector fields A = e; A! +e) A? + 3A, where e, €2, and 
e3 are an orthonormal basis in R?. In that case 


AA =e, AA! + AA? +03AA?. 


Taking account of this last equality, we can write the following relation for the 
triple of second-order operators (14.22): 


curlcurl A = graddiv A — AA, (14.24) 


4P.S. Laplace (1749-1827) — famous French astronomer, mathematician, and physicist; he made 
fundamental contributions to the development of celestial mechanics, the mathematical theory of 
probability, and experimental and mathematical physics. 
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whose proof we shall not take the time to present (see Problem 2 below). The equal- 
ity (14.24) can serve as the definition of AA in any coordinate system, not neces- 
sarily orthogonal. 

Using the language of vector algebra and formulas (14.14)—(14.16), we can write 
all the second-order operators (14.20)—(14.22) in terms of the Hamilton operator V: 


curlgrad f =V x Vf =0, 
divcurlA = V-(V x A) =0, 
graddivA= V(V -A), 
curlcurlA = V x (V x A), 
divgrad f=V-Vf. 


From the point of view of vector algebra the vanishing of the first two of these 
operators seems completely natural. 

The last equality means that the following relation holds between the Hamilton 
operator V and the Laplacian A: 


A=V". 


14.1.5 *Vector Operations in Curvilinear Coordinates 


a. 


Just as, for example, the sphere x? + y? + z* = a? has a particularly simple equation 
R =a in spherical coordinates, vector fields x > A(x) in R? (or R”) often assume 
a simpler expression in a coordinate system that is not Cartesian. For that reason we 
now wish to find explicit formulas from which one can find grad, curl, and div in a 
rather extensive class of curvilinear coordinates. 

But first it is necessary to be precise as to what is meant by the coordinate ex- 
pression for a field A in a curvilinear coordinate system. 

We begin with two introductory examples of a descriptive character. 
Example 3 Suppose we have a fixed Cartesian coordinate system x!, x* in the Eu- 
clidean plane R2. When we say that a vector field (A!, A?)(x) is defined in R?, we 
mean that some vector A(x) € TR2 is connected with each point x = (x!, x?) € R?, 
and in the basis of TR2 consisting of the unit vectors e; (x), e2(x) in the coordinate 
directions we have the expansion A(x) = A! (x)e1 (x) + A?(x)e2(x) (see Fig. 14.1). 
In this case the basis {e; (x), e2(x)} of TR? is essentially independent of x. 


Example 4 In the case when polar coordinates (r,g) are defined in the same 
plane IR?, at each point x € R?\0 one can also attach unit vectors e; (x) = e;(x), 
e2 = ey (x) (Fig. 14.2) in the coordinate directions. They also form a basis in TR 
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Fig. 14.1 Be A(z) 


€2 


el (x) 


Fig. 14.2 


with respect to which one can expand the vector A(x) of the field A attached to 
x: A(x) = Al (x)ey(x) + A?(x)e2(x). It is then natural to regard the ordered pair of 
functions (A!, A%)(x) as the expression for the field A in polar coordinates. 


Thus, if (A!, A*)(x) = (1, 0), this is a field of unit vectors in R? pointing radially 
away from the center 0. 

The field (A!, A2)(x) = (0, 1) can be obtained from the preceding field by rotat- 
ing each vector in it counterclockwise by the angle 2/2. 

These are not constant fields in R*, although the components of their coordinate 
representation are constant. The point is that the basis in which the expansion is 
taken varies synchronously with the vector of the field in a transition from one point 
to another. 

It is clear that the components of the coordinate representation of these fields in 
Cartesian coordinates would not be constant at all. On the other hand, a truly con- 
stant field (consisting of a vector translated parallel to itself to all points of the plane) 
which does have constant components in a Cartesian coordinate system, would have 
variable components in polar coordinates. 


b. 


After these introductory considerations, let us consider more formally the problem 
of defining vector fields in curvilinear coordinate systems. 

We recall first of all that a curvilinear coordinate system ti t7,¢° in a domain 
D CR? isa diffeomorphism y : D; > D of adomain D, in the Euclidean parameter 
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space R} onto the domain D, as - result of which each point x = g(t) € D acquires 
the Cartesian coordinates t!, t7, t? of the corresponding point t € D,. 

Since ¢ is a diffeomorphism, the tangent mapping ¢’(f) : TR} > TT (t 
is a vector-space isomorphism. To the canonical basis &,(t) = (1, 0,0), & a= = 
(0, 1,0), &3(t) = (0,0, 1) of TR} corresponds the basis of TR) consisting of 


the vectors &;(x) = g'(1t)&;(t) = 20), i = 1,2, 3, giving the coordinate directions. 
To the expansion A(x) = a@1& | (x) +a2&>(x) +0383 (x) of any vector A(x) € TR} in 
this basis there corresponds the same expansion A(t) = a1 &; (t) +a2&5(t) +03&3(t) 
(with the same components a1, 02, a3!) of the vector A(t) = (y’)~!A(x) in the 
canonical basis &,(t), &5(t), &3(¢) in TR}. In the absence of a Euclidean struc- 
ture in R?, the numbers a1, #2, «3 would be the most natural coordinate expression 
for the vector A(x) connected with this curvilinear coordinate system. 


However, adopting such a coordinate representation would not be quite consistent 
with what we agreed to in Example 4. The point is that the basis & | (x), &(x), €3(x) 
in TR} corresponding to the canonical basis &;(t), &5(t), &3(¢) in TR}, although 
it consists of vectors in the coordinate directions, is not at all required to consist of 
unit vectors in those directions, that is, in general (&;, &;)(x) 4 1. 

We shall now take account of this circumstance which results from the presence 
of a Euclidean structure in R? and consequently in each vector space TR} also. 

Because of the isomorphism ¢’(f) : TR? > TRI =p(r) We can transfer the Eu- 
clidean structure of TR} into TR} by setting (t1, T2) := (g’T1, gy’ tT) for every pair 
of vectors T, T2 € TR} . In particular, we obtain from this the following expression 
for the square of the length of a vector: 


dp(t)_; I(t) or 
ott” 


(t,t) = (yr. 9'r) -( 


-(% GIO) 


Sita ai lon ‘t! = (E),8))()t't! = gij(t) de! (c) de! (x). 


The quadratic form 
ds* = g;;(t) de! dt/ (14.25) 


whose coefficients are the pairwise inner products of the vectors in the canonical 
basis determines the inner product on TR} completely. If such a form is defined 
at each point of a domain D; C R}, then, as is known from geometry, one says 
that a Riemannian metric is defined in this domain. A Riemannian metric makes 
it possible to introduce a Euclidean structure in each tangent space TR} (t € Dy) 
within the context of rectilinear coordinates t!, 17, 1° in R}, corresponding to the 
“curved” embedding y : D; — D of the domain D, in the Euclidean space R?. 
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If the vectors & (x) = g/(1)é; (1) = a(t), i = 1,2, 3, are orthogonal in TR3, then 
gij(t) =0 fori ¥ j. This means that we are dealing with a triorthogonal coordinate 
grid. In terms of the space TR} it means that the vectors &;(t), i = 1,2, 3, in the 
canonical basis are mutually orthogonal in the sense of the inner product in TR} 
defined by the quadratic form (14.25). In what follows, for the sake of simplicity, 
we shall consider only triorthogonal curvilinear coordinate systems. For them, as 


has been noted, the quadratic form (14.25) has the following special form: 

ds? = Ey (t)(dt!)* + Ep(t)(dt?)? + E3()(dr7)’, (14.26) 
where Ej (t) = gij(t), i = 1, 2,3. 
Example 5 In Cartesian coordinates (x, y, z), cylindrical coordinates (r, g, z), and 


spherical coordinates (R, yg, 8) on Euclidean space IR? the quadratic form (14.25) 
has the respective forms 


ds? = dx? +. dy? +. dz? = (14.26’) 
= dr? +r? dg? + dz? = (14.26”) 
= dR? + R? cos? 6 dy? + R? dé”. (14.26””) 


Thus, each of these coordinate systems is a triorthogonal system in its domain of 
definition. 

The vectors &, (1), &5(t), &3(t) of the canonical basis (1, 0, 0), (0, 1,0), (0, 0, 1) 
in TR}, like the vectors &;(x) € TR} corresponding to them, have the following 
norm: |é;| = ./gii- Hence the unit vectors (in the sense of the square-norm of a 
vector) in the coordinate directions have the following coordinate representation for 
the triorthogonal system (14.26): 


1 1 1 
VE\ VE VE3 
(14.27) 
Example 6 It follows from formulas (14.27) and the results of Example 5 that for 


Cartesian, cylindrical, and spherical coordinates, the triples of unit vectors along the 
coordinate directions have respectively the following forms: 


e, = (1,0, 0), e, = (0, 1,0), e, = (0,0, 1); (14.27') 


1 
e, = (1,0, 0), ey = (0 =; 0), e, = (0, 0, 1); (14.27”) 
r 


5In the triorthogonal system (14.26) we have |&;| = /£; = H;,i = 1, 2,3. The quantities H,, Hp, 
Hy are usually called the Lamé’ coefficient or Lamé’ parameters. G. Lamé (1795-1870) French 
engineer, mathematician, and physicist. 
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1 1 
= (1, 0, 0), = | 0, -—_,0}, =[ 0,0, — }. 14.27” 
el ) * ( Rcosé ) “ ( z) ( ) 


Examples 3 and 4 considered above assumed that the vector of the field was ex- 
panded in a basis consisting of unit vectors along the coordinate directions. Hence 
the vector A(t) € TR} corresponding to the vector A(x) € TR} of the field should 
be expanded in the basis e; (f), e2(f), e3(f) consisting of unit vectors in the coordi- 
nate directions, rather than in the canonical basis &; (t), &5(t), &3(¢). 

Thus, abstracting from the original space R*, one can assume that a Riemannian 
metric (14.25) or (14.26) and a vector field t + A(t) are defined in the domain 
DiC R} and that the coordinate representation (A!, A?, A?)(t) of A(t) at each point 
t € D, is obtained from the expansion of the vector A(t) = A! (t)e;(t) of the field 
corresponding to this point with respect to unit vectors along the coordinate axes. 


d. 


Let us now investigate forms. Under the diffeomorphism g : D; — D every form 
in D automatically transfers to the domain D,. This transfer, as we know, occurs 
at each point x € D from the space TR} into the corresponding space TR}. Since 
we have transferred the Euclidean structure into TR} from TR}, it follows from 
the definition of the transfer of vectors and forms that, for example, to a given form 
o\ (x) = (A(x), -) defined in TR} there corresponds exactly the same kind of form 
o\(t) = (A(f),-) in TR}, where A(x) = y’(t)A(t). The same can be said of forms 
of the type OR and o, to say nothing of forms w®. — that is, functions. 

After these clarifications, the rest of our study can be confined to the domain 
Dz C R}, abstracting from the original space R? and assuming that a Riemannian 
metric (14.25) is defined in D; and that scalar fields f, o and vector fields A, B 
are defined in D; along with the forms oF, ok, OR: ow}, which are defined at each 


point t € D; in accordance with the Euclidean structure on TR? defined by the 
Riemannian metric. 


Example 7 The volume element dV in curvilinear coordinates t!, 17,13, as we 
know, has the form 


dv = /det g;;(t) dt! A dt? Adt?. 
For a triorthogonal system 
dV = /E, ExE3(t) dt! a dt? a dt?. (14.28) 


In particular, in Cartesian, cylindrical, and spherical coordinates, respectively, we 
obtain 


dV =dx Ady Adz= (14.28’) 
=rdr Ady Adz= (14.28”) 
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= R* cos dR Ady Add. (14.28'”) 


What has just been said enables us to write the form wo = pdvV in different 
curvilinear coordinate systems. 


Our main problem (now easily solvable) is, knowing the expansion A(t) = 
Al(t)e;(t) for a vector A(t) € TR} with respect to the unit vectors e;(t) € TR}, 
i = 1,2, 3, of the triorthogonal coordinate system determined by the Riemannian 
metric (14.26), to find the expansion of the forms on (t) and OR (t) in terms of the 
canonical 1-forms dr! and the canonical 2-forms dt! A dt/ respectively. 

Since all the reasoning applies at every given point ¢, we shall abbreviate the 
notation by suppressing the letter ¢ that shows that the vectors and forms are attached 
to the tangent space at f. 

Thus, e1, €2, €3 is a basis in TR? consisting of the unit vectors (14.27) along the 
coordinate directions, and A = Ale; + A7e2 + A%e3 is the expansion of A € TR} 
in that basis. 

We remark first of all that formula (14.27) implies that 
0, fits, 


dt/(e;) = 54, where 54 = | (14.29) 


JE: l, ifi=j, 


i 32 | (0, f& PFC), 
dt’ A dt! (ex, e7) = ——=65,,_ where 5) = G DFC ) (14.30) 
Ej; E; 1, if Gg /p=K,D. 
f 
Thus, if w\ := (A,-:)=aq dt! + ap dt? + a3 dt?, then on the one hand 
wy (ei) = (A, e) = A‘, 


and on the other hand, as one can see from (14.29), 


1 1 2 3 1 
Oa (€i) = (a1 dt’ + a2 dt” + a3 dt )(ei) = ai 
I 


Consequently, aj = A! ./E;, and we have found the expansion 
wh = Al /Ey dt! + A? Eo dt? + A? E3 det? (14.31) 


for the form On corresponding to the expansion A = Ale; + A*e7 + A%e3 of the 
vector A. 
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Example 8 Since in Cartesian, spherical, and cylindrical coordinates we have re- 
spectively 


A= Aye; + Ayey + Aze, = 
= A-e; + Ayeyg + Aze; = 
= Arer + Ageg + Ages, 


as follows from the results of Example 6, 


wo, = A,dx + Aydy+A,dz= (14.31’) 
= A, dr + Agrdg + A,dz= (14.31”) 
= ArdR+ AyRcosydy + AgR dd. (14.31) 


g. 


Now let B = B'e; + B*e7 + B°e3 and wy = by dt? Adt? + bz dt3 Adt! +b3 det! Adt?. 
Then, on the one hand, 


wg (e2, €3) = dV (B, e2, €3) = 


3 
= ))B' dV(ei,e2,e3) = B' - (e1,€2,e3) = B', 
i-1 


where dV is the volume element in TR? see (14.28) and (14.27)). 
On the other hand, by (14.30) we obtain 


wp (€2, €3) = (by, dt? A dt? + by dt? A dt! + b3 dt’ A dt?) (e2, e3) = 


by 


= by dt? A dr3(e, 3) = 
1 (€2, €3) BE 


Comparing these results, we conclude that b} = B!./E E3. Similarly, we verify 
that bo = Bey E, £3 and b3 = BY E, E>. 


Thus we have found the representation 
wp = B/E) E3 dt? a dt? + B?,/E3E, dt? a dt! + B/E) Ep dt! a dt? = 


BI 2 3 B? 3 1 B? 1 2 
= VEEEs( at A dt? + ——= dt? A dt’ + ——dt rar?) (14.32) 
VJ Ey J Eo JV E3 
2 


of the form w, corresponding to the vector B = Be; + Ber + Bre3. 
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Example 9 Using the notation introduced in Example 8 and formulas (14.26’), 
(14.26”) and (14.26”’), we obtain in Cartesian, cylindrical, and spherical coordi- 
nates respectively 


wp = By dy Adz + Bydz Adx + B,dx Ady = (14.32') 
= B,rdg Adz+ Bydz Adr+ B,rdr A dg = (14.32”) 
= BrR’ cosé dy Ado + ByRdO AdR + BeRcosd dR A dg. (14.32’”) 


h. 
We add further that on the basis of (14.28) we can write 
3 1 2 3 
w, =p E\E2E3dt A dt* A dt. (14.33) 


Example 10 In particular, for Cartesian, cylindrical, and spherical coordinates re- 
spectively, formula (14.33) has the following forms: 


ow, = pdx Ady Adz = (14.33’) 
= prdr Ady Adz = (14.33”) 
= pR* cos0dR A dy Add. (14.33’”) 


Now that we have obtained formulas (14.31)—(14.33), it is easy to find the coordi- 
nate representation of the operators grad, curl, and div in a triorthogonal curvilinear 
coordinate system using Definitions (14.9)-(14.11). 

Let grad f = Ale; + A7e) + A%e3. Using the definitions, we write 


of 41, OF 2, Of 13 
dt dt dt~. 
or! - ar + at3 


1 : 0. : 
grad f “= dw i=dfi= 


From this, using formula (14.31), we conclude that 


rad f = : aa + : a =e : LF (14.34) 
OT TR ot ig a JE a8 
Example I1 In Cartesian, cylindrical, and spherical coordinates respectively, 
0 0 0 
grad f= 1 + te. + a = (14.34) 
ax dy Oz 
of lof of 
=e, e e, = 14.34” 
ap de be ( ) 
0 1 a 1a 
R+ J f (14.34) 


=> e e ee. 
aR Reosé a9 * | R290” 
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Suppose given a field A(t) = (Ale; + A72e. + Are3)(t). Let us find the coordi- 


nates B!, B?, B? of the field curl A(t) = B(t) = (B'e; + B7e2 + Be3)(t). 
Based on the definition (14.10) and formula (14.31), we obtain 


outa = do, = (A! VE dt! + A? Ep dt? + A?/E3 dt?) = 


dA2,/E3  JA2/E 
= : > \ de? A de? + 
art? ats 
dAL/E; dJA2/E 
am : 3) ar3 A dt! + 
ars art! 
dA2/E, dJAL/JE 
2 LY at! A de?. 
ar! ar 


On the basis of (14.32) we now conclude that 


gta.) (HAS Awe) 
7 VE E3 at? at3 , 
oe 1 (Ax Awe) 
7 J E3E, ars at! , 
gia =) dA?/E2 Avr) 
- VE\ Eo at! at? , 
that is, 
: VE\e, VE 8 E383 
cul = a a a |. (14.35) 


VE\A! JEA* /E3A3 


Example 12 In Cartesian, cylindrical, and spherical coordinates respectively 


dA, aA dA, 9A aA, 9A 
1A= a Y asguneees 5 , eae i 2= (14.35’ 
a ( ay az Je +( “a tl kee 


1/0A, drAg dA, OA, 1/drAg dA, 
= - e+ ey + e,= 
r\ 0g 0z Oz or r\ or dQ 


1 dAg dAgcosd 1/dArR ORA@ 
— R e€gt 
Rceosé \ dg 00 R\ 06 OR 


1 (dRAg 1 dAR 
: 14.35” 
r( OR cosé dg Je Weed 
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Now suppose given a field B(t) = (Ble; + B7e2 + Be3)(t). Let us find an expres- 
sion for div B. 
Starting from the definition (14.11) and formula (14.32), we obtain 
WdivB ‘= dog = d(Bly Ex E3 dr? A dt? + 
+ B?,/E3E; dt? A dt! + B3/E, Ep dt! a dt? = 


0/E2E3B! 0 /7E3E;B2 0 /E,E2B? 
= ( a a + no ) a A dt? A dt?. 


On the basis of formula (14.33) we now conclude that 


1 0./E0E3B! z 0./E3E| B2 ¢ 0./E1 E72 B? 
JE, Er E3 at! at2 ar? 


In Cartesian, cylindrical, and spherical coordinates respectively, we obtain 


divB= 


). (14.36) 


dB, 9B, aB, 


divB = = 14.36’ 

= ax 7 dy = Oz ( ) 
1/orB, dBg OB, 

= — 14.36” 

r ( or 7 ag ) 7 0z ( ) 

1 dR cosOBr IRBg | dRcosO Be 
ee ; 14.36” 
R2cos@ ( aR - ag 7 06 ) ( ) 


Relations (14.34) and (14.36) can be used to obtain an expression for the Laplacian 
A = div grad in an arbitrary triorthogonal coordinate system: 


Af = div grad f = 


= on( > BF ash : Os : vfe3) = 
7 JE Ot! : J Ed Ot? - JE; at} 7 ae 


_ 1 ( ) ( Ey E3 oo) 4. 
JE, E2E3 \ at! E, at! 
) E3EF, of 0 E\ E of 
: . 14.37 
= ar? (\ E> at) i ar3 (\ E3 03 ee 
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Example 13 In particular, for Cartesian, cylindrical, and spherical coordinates, we 
obtain respectively 


of Pe oF 


Af = = 14.37’ 

f ax? * dy? = dz? ( ) 
1a /(/ af Lay a7 

= = 14.37” 

ror (: ) r2 dg? 7 dz? ( ) 


eal Fc ee ae a ae el (14.37) 
= cos . 
R20R aR R2cos?6 dy? R* cos 6 00 a0 


14.1.6 Problems and Exercises 


1. The operators grad, curl, and div and the algebraic operations. 
Verify the following relations: 
for grad: 


a) Vif+tg)=VF+Ve8, 

b) Vif -s)=fVet+eave, 

c) V(A-B) = (B-V)A+(A- V)B+B x (V x A) +A x (V xB), 
d) V(5A”) = (A-V)A+A x (V x A); 


for curl: 


e) Vx (fA=fVxAt+VE XA, 
f) V x (Ax B) = (B- V)A— (A- V)B+4+ (V- B)A— (V- ADB; 


for div: 


g) V-(fA=Vf-A+t+ fV-A, 
h) V-(Ax B)=B-(V x A)—A-(V xB) 


and rewrite them in the symbols grad, curl, and div. 

(Hints. A- V =A1S +A? 2, +A3 2; B.V4V-B;Ax (BxC) =B(A-C)— 
C(A - B).) ; 
2. a) Write the operators (14.20)—(14.22) in Cartesian coordinates. 

b) Verify relations (14.20) and (14.21) by direct computation. 

c) Verify formula (14.24) in Cartesian coordinates. 

d) Write formula (14.24) in terms of V and prove it, using the formulas of vector 
algebra. 


3. From the system of Maxwell equations in Example 2 deduce that V - j = aie 
4. a) Exhibit the Lamé parameters H, H2, H3 of Cartesian, cylindrical, and spher- 
ical coordinates in R?. 

b) Rewrite formulas (14.28), (14.34)-(14.37), using the Lamé parameters. 


5. Write the field A = grad i, where r = ./x2 + y2 + 2? in 
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a) Cartesian coordinates x, y, Z; 
b) cylindrical coordinates; 

c) spherical coordinates. 

d) Find curl A and div A. 


6. In cylindrical coordinates (r, g,z) the function f has the form In . Write the 
field A = grad f in 


a) Cartesian coordinates; 
b) cylindrical coordinates; 
c) spherical coordinates. 
d) Find curl A and div A. 


7. Write the formula for transformation of coordinates in a fixed tangent space 
TR}, p € R°, when passing from Cartesian coordinates in R? to 


a) cylindrical coordinates; 

b) spherical coordinates; 

c) an arbitrary triorthogonal curvilinear coordinate system. 

d) Applying the formulas obtained in c) and formulas (14.34)-(14.37), verify 
directly that the vector fields grad f, curlA, and the quantities divA and Af are 
invariant relative to the choice of the coordinate system in which they are computed. 


8. The space R*, being a rigid body, revolves about a certain axis with constant 
angular velocity w. Let v be the field of linear velocities of the points at a fixed 
instant of time. 


a) Write the field v in the corresponding cylindrical coordinates. 

b) Find curl v. 

c) Indicate how the field curl v is directed relative to the axis of rotation. 

d) Verify that | curl v| = 2@ at each point of space. 

e) Interpret the geometric meaning of curlv and the geometric meaning of the 
constancy of this vector at all points of space for the situation in d). 


14.2 The Integral Formulas of Field Theory 


14.2.1 The Classical Integral Formulas in Vector Notation 


a. Vector Notation for the Forms OO and or 


In the preceding chapter we noted (see Sect. 13.2, formulas (13.23) and (13.24)) that 
the restriction of the work form Op of a field F to an oriented smooth curve (path) 
y or the restriction of the flux form wy of a field V to an oriented surface S can be 
written respectively in the following forms: 


Orly =(F,e)ds, — wyls = (V,n) do, 
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where e is the unit vector that orients y, codirectional with the velocity vector of the 
motion along y, ds is the element (form) of arc length on y, n is the unit normal 
vector to S that orients the surface, and do is the element (form) of area on S. 

In vector analysis we often use the vector element of length of a curve ds := eds 
and the vector element of area on a surface do := ndo. Using this notation, we can 
now write: 


wh|,, = (A,e) ds = (A, ds) = A- ds, (14.38) 
o,|s = (B,n) do = (B, do) =B-do. (14.39) 


b. The Newton-Leibniz Formula 


Let fe CD, R), and let y : [a,b] — D be a path in the domain D. 
Applied to the 0-form or, Stokes’ formula 


0 0 
| of = | aot 
ay Y 


means, on the one hand, the equality 


[ refer. 


which agrees with the classical formula 


f(y) - f(v@) = / , df(y@) 


a 


of Newton—Leibniz (the fundamental theorem of calculus). On the other hand, by 
definition of the gradient, it means that 


/ oF = 7 Oprad f (14.40) 
ay - Y 


Thus, using relation (14.38), we can rewrite the Newton—Leibniz formula as 


f(y) — f(v@) = [ (ora f)-ds. (14.40’) 
y 


In this form it means that 


the increment of a function on a path equals the work done by the gradient of the function 
on the path. 


This is a very convenient and informative notation. In addition to the obvious 
deduction that the work of the field grad f along a path y depends only on the 
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endpoints of the path, the formula enables us to make a somewhat more subtle ob- 
servation. To be specific, motion over a level surface f = c of f takes place without 
any work being done by the field grad f since in this case grad f - do = 0. Then, 
as the left-hand side of the formula shows, the work of the field grad f depends not 
even on the initial and final points of the path but only on the level surfaces of f to 
which they belong. 


c. Stokes’ Formula 


We recall that the work of a field on a closed path is called the circulation of the field 
on that path. To indicate that the integral is taken over a closed path, we often write 
g, F - ds rather than the traditional notation [ r F - ds. If y is a curve in the plane, we 
often use the symbols f, and ¢,, in which the direction of traversal of the curve y 
is indicated. 

The term circulation is also used when speaking of the integral over some finite 
set of closed curves. For example, it might be the integral over the boundary of a 
compact surface with boundary. 

Let A be a smooth vector field in a domain D of the oriented Euclidean space R? 
and S$ a (piecewise) smooth oriented compact surface with boundary in D. Applied 
to the 1-form w re taking account of the definition of the curl of a vector field, Stokes’ 


formula means the equality 
| OA = | oun: (14.41) 
as S 


Using relation (14.39), we can rewrite (14.41) as the classical Stokes formula 


$ A-ds= ff (eurta)- a0, (14.41’) 
as S 


In this notation it means that 


the circulation of a vector field on the boundary of a surface equals the flux of the curl of 
the field across the surface. 


As always, the orientation chosen on 0S is the one induced by the orientation 
of S. 
d. The Gauss—Ostrogradskii Formula 


Let V be a compact domain of the oriented Euclidean space R?* bounded by a 
(piecewise-) smooth surface dV, the boundary of V. If B is a smooth field in V, 
then in accordance with the definition of the divergence of a field, Stokes’ formula 


yields the equality 
/ on = / Dion: (14.42) 
av V 
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3 
p 
volume element dV in R*, we can rewrite Eq. (14.42) as the classical Gauss— 


Ostrogradskii formula 
| B-.do = II divBdV. (14.42’) 
av v 


the flux of a vector field across the boundary of a domain equals 
the integral of the divergence of the field over the domain itself. 


Using relation (14.39) and the notation odV for the form w* in terms of the 


In this form it means that 


e. Summary of the Classical Integral Formulas 


In sum, we have arrived at the following vector notation for the three classical inte- 
gral formulas of analysis: 


/ f= | (Vf)-ds (the Newton—Leibniz formula), (14.40”) 

ay Y 

i A-ds= [eo x A)-do (Stokes’ formula), (14.41”) 
as S 


| B-do= / (V-B)dV_ (the Gauss—Ostrogradskii formula). (14.42”) 
av Vv 


14.2.2 The Physical Interpretation of div, curl, and grad 


a. The Divergence 


Formula (14.42’) can be used to explain the physical meaning of div B(x) — the 
divergence of the vector field B at a point x in the domain V in which the field is 
defined. Let V(x) be a neighborhood of x (for example, a ball) contained in V. We 
permit ourselves to denote the volume of this neighborhood by the same symbol 
V(x) and its diameter by the letter d. 

By the mean-value theorem and the formula (14.42’) we obtain the following 
relation for the triple integral 


| B- do = div B(x’) V(x), 
aV(x) 


where x’ is a point in the neighborhood V(x). If d > 0, then x’ > x, and since B 
is a smooth field, we also have div B(x’) — div B(x). Hence 


Laven) B-do 


aes (14.43) 


divB(x) = lim 
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Let us regard B as the velocity field for a flow (of liquid or gas). Then, by the 
law of conservation of mass, a flux of this field across the boundary of the domain 
V or, what is the same, a volume of the medium diverging across the boundary of 
the domain, can arise only when there are sinks or sources (including those asso- 
ciated with a change in the density of the medium). The flux is equal to the total 
power of all these factors, which we shall collectively call “sources”, in the domain 
V(x). Hence the fraction on the right-hand side of (14.43) is the mean intensity (per 
unit volume) of sources in the domain V(x), and the limit of that quantity, that is, 
div B(x), is the specific intensity (per unit volume) of the source at the point x. But 
the limit of the ratio of the total amount of some quantity in the domain V(x) to 
the volume of that domain as d —> 0 is customarily called the density of that quan- 
tity at x, and the density as a function of a point is usually called the density of the 
distribution of the given quantity in a portion of space. 

Thus, we can interpret the divergence divB of a vector field B as the density 
of the distribution of sources in the domain of the flow, that is, in the domain of 
definition of the field B. 


Example I If, in particular, div B = 0, that is, there are no sources, then the flux 
across the boundary of the region must be zero: the amount flowing in equals the 
amount flowing out. And, as formula (14.42’) shows, this is indeed the case. 


Example 2 A point electric charge of magnitude g creates an electric field in space. 
Suppose the charge is located at the origin. By Coulomb’s law® the intensity E = 
E(x) of the field at the point x € R°? (that is, the force acting on a unit test charge at 
the point x) can be written as 


q r 
~ Asréo |r|3’ 


where &o is a dimensioning constant and r is the radius-vector of the point x. 

The field E is defined at all points different from the origin. In spherical coor- 
dinates E = rer qoeR: so that by formula (14.36”") of the preceding section, one 
can see immediately that div E = 0 everywhere in the domain of definition of the 
field E. 

Hence, if we take any domain V not containing the origin, then by formula 
(14.42’) the flux of E across the boundary 0V of V is zero. 

Let us now take the sphere Sr = {x € R? | |x| = R} of radius R with center at 
the origin and find the outward flux (relative to the ball bounded by the sphere) of 
E across this surface. Since the vector ep is itself the unit outward normal to the 
sphere, we find 


1 
[ eeo=/ ft — do =—1_, carr? = 4. 
Sp Sp 47€0 R AreoR E0 


6Ch.O. Coulomb (1736-1806) — French physicist. He discovered experimentally the law 
(Coulomb’s law) of interaction of charges and magnetic fields using a torsion balance that he 
invented himself. 


14.2 The Integral Formulas of Field Theory 281 


Thus, up to the dimensioning constant ¢9, which depends on the choice of the 
system of physical units, we have found the amount of charge in the volume bounded 
by the sphere. 


We remark that under the hypotheses of Example 2 just studied the left-hand 
side of formula (14.42’) is well-defined on the sphere 0V = Sp, but the integrand 
on the right-hand side is defined and equal to zero everywhere in the ball V except 
at one point — the origin. Nevertheless, the computations show that the integral on 
the right-hand side of (14.42’) cannot be interpreted as the integral of a function that 
is identically zero. 

From the formal point of view one could dismiss the need to study this situation 
by saying that the field E is not defined at the point 0 € V, and hence we do not have 
the right to speak about the equality (14.42’), which was proved for smooth fields 
defined in the entire domain V of integration. However, the physical interpretation 
of (14.42’) as the law of conservation of mass shows that, when suitably interpreted, 
it ought to be valid always. 

Let us study the indeterminacy of divE at the origin in Example 2 more atten- 
tively to see what is causing it. Formally the original field E is not defined at the 
origin, but, if we seek divE from formula (14.43), then, as Example 2 shows, we 
would have to assume that div E(0) = +oo. Hence the integrand on the right-hand 
side of (14.42) would be a “function” equal to zero everywhere except at one point, 
where it is equal to infinity. This corresponds to the fact that there are no charges 
at all outside the origin, and we somehow managed to put the entire charge g into 
a space of volume zero — into the single point 0, at which the charge density nat- 
urally became infinite. Here we are encountering the so-called Dirac’ 5-function 
(delta-function). 

The densities of physical quantities are needed ultimately so that one can find the 
values of the quantities themselves by integrating the density. For that reason there 
is no need to define the 6-function at each individual point; it is more important 
to define its integral. If we assume that physically the “function” 5x, (x) = 5(x0; x) 
must correspond to the density of a distribution, for example the distribution of mass 
in space, for which the entire mass, equal to | in magnitude, is concentrated at the 
single point xq, it is natural to set 


1, whenxoe V, 
| 5(x9,x) dV = 
Vv 0, whenxo¢V. 


Thus, from the point of view of a mathematical idealization of our ideas of the 
possible distribution of a physical quantity (mass, charge, and the like) in space, we 
must assume that its distribution density is the sum of an ordinary finite function 
corresponding to a continuous distribution of the quantity in space and a certain set 


7P.A.M. Dirac (1902-1984) — British theoretical physicist, one of the founders of quantum me- 
chanics. More details on the Dirac 5-function will be given in Sects. 17.4.4 and 17.5.4. 
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of singular “functions” (of the same type as the Dirac 5-function) corresponding to 
a concentration of the quantity at individual points of space. 

Hence, starting from these positions, the results of the computations in Exam- 
ple 2 can be expressed as the single equality divE = £5(0; x). Then, as applied to 
the field E, the integral on the right-hand side of (14.42’) is indeed equal either to 
q/&o or to 0, according as the domain V contains the origin (and the point charge 
concentrated there) or not. 

In this sense one can assert (following Gauss) that the flux of electric field in- 
tensity across the surface of a body equals (up to a factor depending on the units 
chosen) the sum of the electric charges contained in the body. In this same sense 
one must interpret the electric charge density p in the Maxwell equations consid- 
ered in Sect. 14.1 (formula (14.12)). 


b. The Curl 
We begin our study of the physical meaning of the curl with an example. 


Example 3 Suppose the entire space, regarded as a rigid body, is rotating with con- 
stant angular speed w about a fixed axis (let it be the x-axis). Let us find the curl of 
the field v of linear velocities of the points of space. (The field is being studied at 
any fixed instant of time.) 

In cylindrical coordinates (r, g, z) we have the simple expression v(r, g, z) = 
wrey. Then by formula (14.35”) of Sect. 14.1, we find immediately that curly = 
2we,. That is, curl v is a vector directed along the axis of rotation. Its magnitude 2 
equals the angular velocity of the rotation, up to the coefficient 2, and the direction 
of the vector, taking account of the orientation of the whole space R*, completely 
determines the direction of rotation. 


The field described in Example 3 in the small resembles the velocity field of 
a funnel (sink) or the field of the vorticial motion of air in the neighborhood of a 
tornado (also a sink, but one that drains upward). Thus, the curl of a vector field 
at a point characterizes the degree of vorticity of the field in a neighborhood of the 
point. 

We remark that the circulation of a field over a closed contour varies in direct 
proportion to the magnitude of the vectors in the field, and, as one can verify using 
the same Example 3, it can also be used to characterize the vorticity of the field. 
Only now, to describe completely the vorticity of the field in a neighborhood of a 
point, it is necessary to compute the circulation over contours lying in three different 
planes. Let us now carry out this program. 

We take a disk S$; (x) with center at the point x and lying in a plane perpendicular 
to the ith coordinate axis, i = 1,2, 3. We orient S; (x) using a normal, which we take 
to be the unit vector e; along this coordinate axis. Let d be the diameter of 5; (x). 
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From formula (14.41’) for a smooth field A we find that 


ys, (y) Ads 


on (14.44) 


(curl A) - e; = lim 
d—0 


where §;(x) denotes the area of the disk under discussion. Thus the circulation of 
the field A over the boundary 0S; per unit area in the plane orthogonal to the ith 
coordinate axis characterizes the ith component of curl A. 

To clarify still further the meaning of the curl of a vector field, we recall that 
every linear transformation of space is a composition of dilations in three mutually 
perpendicular directions, translation of the space as a rigid body, and rotation as a 
rigid body. Moreover, every rotation can be realized as a rotation about some axis. 
Every smooth deformation of the medium (flow of a liquid or gas, sliding of the 
ground, bending of a steel rod) is locally linear. Taking account of what has just been 
said and Example 3, we can conclude that if there is a vector field that describes the 
motion of a medium (the velocity field of the points in the medium), then the curl of 
that field at each point gives the instantaneous axis of rotation of a neighborhood of 
the point, the magnitude of the instantaneous angular velocity, and the direction of 
rotation about the instantaneous axis. That is, the curl characterizes completely the 
rotational part of the motion of the medium. This will be made slightly more precise 
below, where it will be shown that the curl should be regarded as a sort of density 
for the distribution of local rotations of the medium. 


c. The Gradient 


We have already said quite a bit about the gradient of a scalar field, that is, about the 
gradient of a function. Hence at this point we shall merely recall the main things. 

Since Osrad f (€) = (grad f,€) =df(€) = Dg f, where Dg f is the derivative of 
the function f with respect to the vector &, it follows that grad f is orthogonal to the 
level surfaces of f, and at each point it points in the direction of most rapid increase 
in the values of the function. Its magnitude | grad f| gives the rate of that growth 
(per unit of length in the space in which the argument varies). 

The significance of the gradient as a density will be discussed below. 


14.2.3 Other Integral Formulas 


a. Vector Versions of the Gauss—Ostrogradskii Formula 


The interpretation of the curl and gradient as vector densities, analogous to the inter- 
pretation (14.43) of the divergence as a density, can be obtained from the following 
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classical formulas of vector analysis, connected with the Gauss—Ostrogradskii for- 
mula. 


| V-BdV= | do-B_ (the divergence theorem), (14.45) 
V av 
| VxAdV= i do x A_ (the curl theorem), (14.46) 
V av 
/ VfdV= | do f (the gradient theorem). (14.47) 
V av 


The first of these three relations coincides with (14.42’) up to notation and is the 
Gauss—Ostrogradskii formula. The vector equalities (14.46) and (14.47) follow from 
(14.45) if we apply that formula to each component of the corresponding vector 
field. 

Retaining the notation V(x) and d used in Eq. (14.43), we obtain from formulas 
(14.45)-(14.47) in a unified manner, 


Java) do -B 
V-B = lim ——————_ 14.43’ 
mea VG). nen 
Java de x A 
VxA = im ———_ 14.4 
Oa vay a 
Javan dof 
V = lim —W. 14.4 
FO) Fm Top a 


The right-hand sides of (14.45)-(14.47) can be interpreted respectively as the 
scalar flux of the vector field B, the vector flux of the vector field A, and the 
vector flux of the scalar field f across the surface 0V bounding the domain V. 
Then the quantities div B, curl A, and grad f on the left-hand sides of Eqs. (14.43’), 
(14.48), and (14.49) can be interpreted as the corresponding source densities of these 
fields. 

We remark that the right-hand sides of Eqs. (14.43’), (14.48), and (14.49) are 
independent of the coordinate system. From these we can once again derive the 
invariance of the gradient, curl, and divergence. 


b. Vector Versions of Stokes’ Formula 


Just as formulas (14.45)-(14.47) were the result of combining the Gauss—Ostro- 
gradskii formula with the algebraic operations on vector and scalar fields, the fol- 
lowing triple of formulas can be obtained by combining these same operations with 
the classical Stokes formula (which appears as the first of the three relations). 
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Let S be a (piecewise-) smooth compact oriented surface with a consistently 
oriented boundary 0S, let do be the vector element of area on S, and ds the vector 
element of length on 0S. Then for smooth fields A, B, and /, the following relations 
hold: 


[eowxa= f ds- A, (14.50) 
S as 
[eo x V) B= / ds x B, (14.51) 
Ss as 
[iv x ve= | ds f. (14.52) 
Ss as 


Formulas (14.51) and (14.52) follow from Stokes’ formula (14.50). We shall not 
take time to give the proofs. 


c. Green’s Formulas 


If S is a surface and n a unit normal vector to S, then the derivative Da f of the 
function f with respect to n is usually denoted °F in field theory. For example, 


on . : 
V f,do) = (Vf,n) do = (grad f,n)do = Daf do = “do. Thus, ®4 do is the 
g ‘ on on 


flux of grad f across the element of surface do. 
In this notation we can write the following formulas of Green, which are very 
widely used in analysis: 


[vr-veav+ [ ev?rav= / «vs -do(= | cde), (14.53) 
Vv Vv av av on 


i: (evs — fV2g) dV = 


0 0 
=a, (eV f — fVg)-do -|/ oi - 8) do). (14.54) 
av av on on 
In particular, if we set f = g in (14.53) and g = 1 in (14.54), we find respectively, 
2 af / 
IVfl-dV+ ] fAfdV = fAf -do| = f——do), (14.53) 
Vv V av av. on 


[ arav= [ vi-do(= [ Ha). (14.54’) 
Vv av av On 


This last equality is often called Gauss’ theorem. Let us prove, for example, the 
second of Eqs. (14.53) and (14.54): 
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Proof 


7 (gV f — fVg) do ay V+ (gVf — fVg)dV = 
OV Vv 


= [vs Vi tev? f—Vf-Ve— fV2e) dV = 


= | (ev? f — fV29) dV = | (g Af — f Ag) dV. 
Vv Vv 


In this formula we have used the Gauss—Ostrogradskii formula and the relation 
V-(@A)=Ve-A+@V.-A. 


14.2.4 Problems and Exercises 


1. Using the Gauss—Ostrogradskii formula (14.45), prove relations (14.46) and 
(14.47). 

2. Using Stokes’ formula (14.50), prove relations (14.51) and (14.52). 

3. a) Verify that formulas (14.45), (14.46), and (14.47) remain valid for an un- 
bounded domain V if the integrands in the surface integrals are of order O(5) as 
r — oo. (Here r = |r|, and r is the radius-vector in R?.) 

b) Determine whether formulas (14.50), (14.51), and (14.52) remain valid for a 
noncompact surface S C R? if the integrands in the line integrals are of order O() 
asr—> oo. 

c) Give examples showing that for unbounded surfaces and domains Stokes’ 
formula (14.41’) and the Gauss—Ostrogradskii formula (14.42’) are in general not 
true. 


4. a) Starting from the interpretation of the divergence as a source density, explain 
why the second of the Maxwell equations (formula (14.12) of Sect. 14.1) implies 
that there are no point sources in the magnetic field (that is, there are no magnetic 
charges). 

b) Using the Gauss—Ostrogradskii formula and the Maxwell equations (formula 
(14.12) of Sect. 14.1), show that no rigid configuration of test charges (for example 
a single charge) can be in a stable equilibrium state in the domain of an electrostatic 
field that is free of the (other) charges that create the field. (It is assumed that no 
forces except those exerted by the field act on the system.) This fact is known as 
Earnshaw’s theorem. 


5. If an electromagnetic field is steady, that is, independent of time, then the system 
of Maxwell equations (formula (14.12) of Sect. 14.1) decomposes into two indepen- 
dent parts — the electrostatic equations V -E = a , Vx E=0, and the magnetostatic 


equations V x B= —5 V-B=0. 


el 
ocr? 
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The equation V - E = p/éo, where p is the charge density, transforms via the 
Gauss—Ostrogradskii formula into J ,E- do = Q/e0, where the left-hand side is the 
flux of the electric field intensity across the closed surface S and the right-hand side 
is the sum Q of the charges in the domain bounded by S, divided by the dimension- 
ing constant ¢q. In electrostatics this relation is usually called Gauss’ law. Using 
Gauss’ law, find the electric field E 


a) created by a uniformly charged sphere, and verify that outside the sphere it is 
the same as the field of a point charge of the same magnitude located at the center 
of the sphere; 

b) of a uniformly charged line; 

c) of a uniformly charged plane; 

d) of a pair of parallel planes uniformly charged with charges of opposite sign; 

e) of a uniformly charged ball. 


6. a) Prove Green’s formula (14.53). 

b) Let f be a harmonic function in the bounded domain V (that is, f satisfies 
Laplace’s equation Af = 0 in V). Show, starting from (14.54’) that the flux of the 
gradient of this function across the boundary of the domain V is zero. 

c) Verify that a harmonic function in a bounded connected domain is determined 
up to an additive constant by the values of its normal derivative on the boundary of 
the domain. 

d) Starting from (14.53’), prove that if a harmonic function in a bounded domain 
vanishes on the boundary, it is identically zero throughout the domain. 

e) Show that if the values of two harmonic functions are the same on the bound- 
ary of a bounded domain, then the functions are equal in the domain. 

f) Starting from (14.53), verify the following principle of Dirichlet. Among all 
continuous differentiable functions in a domain assuming prescribed values on the 
boundary, a harmonic function in the region is the only one that minimizes the 
Dirichlet integral (that is, the integral of the squared-modulus of the gradient over 
the domain). 


7. a) Let r(p,q) =|p —q| be the distance between the points p and q in the Eu- 
clidean space R*. By fixing p, we obtain a function rp(q) of gE R>. Show that 
Ay" (q) = 46(p; q), where 6 is the 5-function. 

b) Let g be harmonic in the domain V. Setting f = 1/rp in (14.54) and taking 
account of the preceding result, we obtain 


1 1 
anein)= [ (ev—- —ve) ‘do. 
Ss Tp Vp 


Prove this equality precisely. 
c) Deduce from the preceding equality that if S is a sphere of radius R with 
center at p, then 


1 
= —_ | gdo. 
g(P) culls o 


This is the so-called mean-value theorem for harmonic functions. 
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d) Starting from the preceding result, show that if B is the ball bounded by the 
sphere S considered in part c) and V(B) is its volume, then 


1 
= Ga | sav. 


e) If p and gq are points of the Euclidean plane R?, then along with the func- 
tion 1 considered in a) above (corresponding to the potential of a charge located 
Dp 


at p), we now take the function In a (corresponding to the potential of a uniformly 
charged line in space). Show that AIn S = 2765(p;q), where 5(p; qg) is now the 


6-function in R?. 
f) By repeating the reasoning in a), b), c), and d), obtain the mean-value theorem 
for functions that are harmonic in plane regions. 


8. Cauchy’s multi-dimensional mean-value theorem. 

The classical mean-value theorem for the integral (“Lagrange’s theorem’’) asserts 
that if the function f : D — R is continuous on a compact, measurable, and con- 
nected set D C R” (for example, in a domain), then there exists a point € € D such 
that 


| f(x) dx = f(&)-|DI, 
D 


where | D| is the measure (volume) of D. 


a) Now let f, g € C(D, R), that is, f and g are continuous real-valued functions 
in D. Show that the following theorem (“Cauchy’s theorem’) holds: There exists 
€ € D such that 


e(é) i, fax = f© / seus 
D D 


b) Let D be a compact domain with smooth boundary 0D and f and g two 
smooth vector fields in D. Show that there exists a point € € D such that 


div g(é) - Fluxf = divf(é) - Fluxg, 
aD aD 


where Flux is the flux of a vector field across the surface 0D. 


14.3 Potential Fields 


14.3.1 The Potential of a Vector Field 


Definition 1 Let A be a vector field in the domain D C R”. A function U: D> R 
is called a potential of the field A if A= grad U in D. 
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Definition 2 A field that has a potential is called a potential field. 


Since the partial derivatives of a function determine the function up to an additive 
constant in a connected domain, the potential is unique in such a domain up to an 
additive constant. 

We briefly mentioned potentials in the first part of this course. Now we shall 
discuss this important concept in somewhat more detail. In connection with these 
definitions we note that when different force fields are studied in physics, the po- 
tential of a field F is usually defined as a function U such that F = — grad U. This 
potential differs from the one given in Definition | only in sign. 


Example I At a point of space having radius-vector r the intensity F of the grav- 
itational field due to a point mass M located at the origin can be computed from 
Newton’s law as 
r 
F=-GM.,, (14.55) 
r 
where r = |r|. 
This is the force with which the field acts on a unit mass at this point of space. The 
gravitational field (14.55) is a potential field. Its potential in the sense of Definition 1 
is the function 


1 
U=GM-. (14.56) 
r 


Example 2 Ata point of space having radius-vector r the intensity E of the electric 
field due to a point charge g located at the origin can be computed from Coulomb’s 
law 
q vr 
ao 4a EQ re 


Thus such an electrostatic field, like the gravitational field, is a potential field. Its 
potential g in the sense of physical terminology is defined by the relation 


a od 
~ Agegr’ 


14.3.2 Necessary Condition for Existence of a Potential 


In the language of differential forms the equality A = gradU means that o\ — 
dw?, = dU, from which it follows that 


doi =0, (14.57) 


since dof, = 0. This is a necessary condition for the field A to be a potential field. 
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In Cartesian coordinates this condition Hn be expressed very simply. If A = 
(A!,..., A”) and A = grad U, then A’ = a ,i=1,...,n, and if the potential U is 
subnciently smooth (for example, if its gene order anal derivatives are continu- 
ous), we must have 

adi a Al 
axi Axi’ 


which simply means that the mixed partial derivatives are equal in both orders: 


i, j=1,...,7, (14.57’) 


ou ou 
Ox'dxJ — AxJaxi” 


In Cartesian coordinates ON =) 4 A! dx', and therefore the equalities (14.57) 
and (14.57’) are indeed equivalent in this case. 

In the case of R? we have dak = Ces a> SO that the necessary condition (14.57) 
can be rewritten as 


curlA = 0, 


which corresponds to the relation curl grad U = 0, which we already know. 


Example 3 The field A = (x, xy, Ae) in _aniestan coordinates in R? cannot be a 
potential field, since, for example, 2% ra Df 


Example 4 Consider the field A = (A;, Ay) given by 


y x 
A= ; , 14.58 
( x? + y? Ero, ee 
defined in Cartesian coordinates at all points of the plane et the ouem The 
necessary condition for a field to be a potential field dAx a ce 


case. However, as we shall soon verify, this field is not a yotental field in its domain 
of definition. 


Thus the necessary condition (14.57), or, in Cartesian coordinates (14.57’), is in 
general not sufficient for a field to be a potential field. 


14.3.3 Criterion for a Field to be Potential 


Proposition 1 A continuous vector field A in a domain D C R" is a potential field 
in D if and only if its circulation (work) around every closed curve y contained in D 
is Zero: 


$ A-ds=0. (14.59) 
Y 
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Proof Necessity. Suppose A = grad U. Then by the Newton—Leibniz formula (For- 
mula (14.40’) of Sect. 14.2), 


f A-ds= U(y(b)) — U(y(@)), 
Y 


where y : [a,b] > D. If y(a) = y (0), that is, when the path y is closed, it is ob- 
vious that the right-hand side of this last equality vanishes, and hence the left-hand 
side does also. 


Sufficiency. Suppose condition (5) holds. Then the integral over any (not necessar- 
ily closed) path in D depends only on its initial and terminal points, not on the path 
joining them. Indeed, if y; and y2 are two paths having the same initial and termi- 
nal points, then, traversing first y;, then —y2 (that is, traversing y2 in the opposite 
direction), we obtain a closed path y whose integral, by (14.59), equals zero, but 
is also the difference of the integrals over y; and y2. Hence these last two integrals 
really are equal. 
We now fix some point x9 € D and set 


U(x) = i A-ds, (14.60) 


0 
where the integral on the right is the integral over any path in D from xo to x. We 
shall verify that the function U so defined is the required potential for the field A. 
For convenience, we shall assume that a Cartesian coordinate system (x!, song”) 
has been chosen in R”. Then A- ds = A! dx! +.-- + A” dx”. If we move away 
from x along a straight line in the direction he;, where e; is the unit vector along the 
x!-axis, the function U receives an increment equal to 
x! nh! 
U(x + hej) — U(x) = a PO cg Gt ey sg a ae 


x 


equal to the integral of the form A - ds over this path from x to x + he;. By the 
continuity of A and the mean-value theorem, this last equality can be written as 


U(x + he;) — U(x) = Al(x!,...,x7 71 x! + 0h, x!) xh, 


where 0 < 6 < 1. Dividing this last equality by h and letting h tend to zero, we find 


dU 
aot 7 (x) = Al (x), 
% 


that is, A= grad U. 


Remark 1 As can be seen from the proof, a sufficient condition for a field to be a 
potential field is that (14.59) hold for smooth paths or, for example, for broken lines 
whose links are parallel to the coordinate axes. 
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We now return to Example 4. Earlier (Example 1 of Sect. 8.1) we computed that 
the circulation of the field (14.58) over the circle x? + y? = | traversed once in the 
counterclockwise direction was 27 (4 0). 

Thus, by Proposition | we can conclude that the field (14.58) is not a potential 
field in the domain R*\0. 

But surely, for example, 


grad arctan i z : z , 
x x2 + y? x2 + y2 


and it would seem that the function arctan = is a potential for (14.58). What is this, 
a contradiction?! There is no contradiction as yet, since the only correct conclusion 
that one can make in this situation is that the function arctan 2 is not defined in the 
entire domain R?\0. And that is indeed the case: Take for example, the points on 
the y-axis. But then, you may say, we could consider the function g(x, y), the polar 
angular coordinate of the point (x, y). That is practically the same thing as arctan 2, 
but g(x, y) is also defined for x = 0, provided the point (x, y) is not at the origin. 
Throughout the domain R?\0 we have 

y x 
However, there is still no contradiction, although the situation is now more delicate. 
Please note that in fact g is not a continuous single-valued function of a point in 
the domain R*\0. As a point encircles the origin counterclockwise, its polar angle, 
varying continuously, will have increased by 27 when the point returns to its starting 
position. That is, we arrive at the original point with a new value of the function, 
different from the one we began with. Consequently, we must give up either the 
continuity or the single-valuedness of the function g in the domain R*\0. 

In a small neighborhood (not containing the origin) of each point of the domain 
R*\0 one can distinguish a continuous single-valued branch of the function g. All 
such branches differ from one another by an additive constant, a multiple of 27. 
That is why they all have the same differential and can all serve locally as potentials 
of the field (14.58). Nevertheless, the field (14.58) has no potential in the entire 
domain R*\0. 

The situation studied in Example 4 turns out to be typical in the sense that the 
necessary condition (14.57) or (14.57’) for the field A to be a potential field is locally 
also sufficient. The following proposition holds. 


Proposition 2 [f the necessary condition for a field to be a potential field holds in 
a ball, then the field has a potential in that ball. 


Proof For the sake of intuitiveness we first carry out the proof in the case of a disk 
D ={(x, y) € R? | x* + y? <r} in the plane R?. One can arrive at the point (x, y) 
of the disk from the origin along two different two-link broken lines y; and y2 with 
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Fig. 14.3 


links parallel to the coordinate axes (see Fig. 14.3). Since D is a convex domain, the 
entire rectangle J bounded by these lines is contained in D. 
By Stokes’ formula, taking account of condition (14.57), we obtain 


/ ok = | doh =0. 
ol I 


By the remark to Proposition 1 we can conclude from this that the field A is 
a potential field in D. Moreover, by the proof of sufficiency in Proposition 1, the 
function (14.60) can again be taken as the potential, the integral being interpreted 
as the integral over a broken line from the center to the point in question with links 
parallel to the axes. In this case the independence of the choice of path y, y2 for 
such an integral followed immediately from Stokes’ formula for a rectangle. 

In higher dimensions it follows from Stokes’ formula for a two-dimensional rect- 
angle that replacing two adjacent links of the broken line by two links forming the 
sides of a rectangle parallel to the original does not change the value of the integral 
over the path. Since one can pass from one broken-line path to any other broken-line 
path leading to the same point by a sequence of such reconstructions, the potential 
is unambiguously defined in the general case. 


14.3.4 Topological Structure of a Domain and Potentials 


Comparing Example 4 and Proposition 2, one can conclude that when the necessary 
condition (14.57) for a field to be a potential field holds, the question whether it 
is always a potential field depends on the (topological) structure of the domain in 
which the field is defined. The following considerations (here and in Sect. 14.3.5 
below) give an elementary idea as to exactly how the characteristics of the domain 
bring this about. 

It turns out that if the domain D is such that every closed path in D can be 
contracted to a point of the domain without going outside the domain, then the 
necessary condition (14.57) for a field to be a potential field in D is also sufficient. 
We shall call such domains simply connected below. A ball is a simply connected 
domain (and that is why Proposition 2 holds). But the punctured plane R7\0 is 
not simply connected, since a path that encircles the origin cannot be contracted 
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Fig. 14.4 


to a point without going outside the region. This is why not every field in R*\0 
satisfying (14.57’), as we saw in Example 4, is necessarily a potential field in R?\0. 

We now turn from the general description to precise formulations. We begin by 
stating clearly what we mean we speak of deforming or contracting a path. 


Definition 3 A homotopy (or deformation) in D from a closed path yo : [0, 1] > 
D to a closed path y; : [0,1] > D is a continuous mapping I" : 1* > D of the 
square [* = {(t!, 12) € R?|0<t! <1,i =1, 2} into D such that F(t!, 0) = y(t), 
rt!, 1) =y(t!), and (0, t?) = 1, t?) for all t!, t? € [0, 1]. 


Thus a homotopy is a mapping I”: J? —> D (Fig. 14.4). If the variable t? is 
regarded as time, according to Definition 3 at each instant of time t = t* we have 
a closed path P’(t!, t) = y; (Fig. 14.4).° The change in this path with time is such 
that at the initial instant t = 17 = 0 it coincides with yp and at time f = 17 = 1 it 
becomes yj. 

Since the condition y, (0) = (0, t) = (1, t) = y% (1), which means that the path 
y: is closed, holds at all times ¢ € [0,1], the mapping I" : /* > D induces the 
same mappings Bo(t!) =T(t!,0) =r! D=: Bi (t!) on the vertical sides of the 
square I. 

The mapping I" is a formalization of our intuitive picture of gradually deforming 
yo toy. 

It is clear that time can be allowed to run backwards, and then we obtain the path 
yo from 1. 


Definition 4 Two closed paths are homotopic in a domain if they can be obtained 
from each other by a homotopy in that domain, that is a homotopy can be con- 
structed in that domain from one to the other. 


8Orienting arrows are shown along certain curves in Fig. 14.4. These arrows will be used a little 
later; for the time being the reader should not pay any attention to them. 
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Remark 2 Since the paths we have to deal with in analysis are as a rule paths of 
integration, we shall consider only smooth or piecewise-smooth paths and smooth 
or piecewise-smooth homotopies among them, without noting this explicitly. 


For domains in R” one can verify that the presence of a continuous homotopy of 
(piecewise-) smooth paths guarantees the existence of (piecewise-) smooth homo- 
topies of these paths. 


Proposition 3 [f the 1-form Oh in the domain D is such that dak = 0, and the 
closed paths yo and y, are homotopic in D, then 


Proof Let ': 1 + D be a homotopy from yo to y; (see Fig. 14.4). If Jo and 1 
are the bases of the square /* and Jo and J its vertical sides, then by definition of 
a homotopy of closed paths, the restrictions of I” to Jj and J; coincide with yo and 
y1 respectively, and the restrictions of I” to Jo and J; give some paths fo and fp; 
in D. Since I(0, 1) =I, t?), the paths Bo and 6; are the same. As a result of the 
change of variables x = I(t), the form w rn transfers to the square J? as some 1-form 
o= [O). In the process dw = dr*wh =f* dak = 0, since dak = 0. Hence, by 


Stokes’ formula 
| o= ; dw = 0. 
al? 2 


But 


Definition 5 A domain is simply connected if every closed path in it is homotopic 
to a point (that is, a constant path). 


Thus simply connected domains are those in which every closed path can be 
contracted to a point. 


Proposition 4 [f a field A defined in a simply connected domain D satisfies the 
necessary condition (14.57) or (14.57’) to be a potential field, then it is a potential 
field in D. 


Proof By Proposition | and Remark | it suffices to verify that Eq. (14.59) holds for 
every smooth path y in D. The path y is by hypothesis homotopic to a constant 
path whose support consists of a single point. The integral over such a one-point 
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path is obviously zero. But by Proposition 3 the integral does not change under a 
homotopy, and so Eq. (14.59) must hold for y. 


Remark 3 Proposition 4 subsumes Proposition 2. However, since we had certain 
applications in mind, we considered it useful to give an independent constructive 
proof of Proposition 2. 


Remark 4 Proposition 2 was proved without invoking the possibility of a smooth 
homotopy of smooth paths. 


14.3.5 Vector Potential. Exact and Closed Forms 


Definition 6 A field A is a vector potential for a field B in a domain D C R? if the 
relation B = curl A holds in the domain. 


If we recall the connection between vector fields and forms in the oriented Eu- 
clidean space R? and also the definition of the curl of a vector field, the rela- 
tion B = curlA can be rewritten as OR = do}. It follows from this relation that 


Oa = dor = CONN = 0. Thus we obtain the necessary condition 
divB =0, (14.61) 


which the field B must satisfy in D in order to have a vector potential, that is, in 
order to be the curl of a vector field A in that domain. 

A field satisfying condition (14.61) is often, especially in physics, called a 
solenoidal field. 


Example 5 In Sect. 14.1 we wrote out the system of Maxwell equations. The second 
equation of this system is exactly Eq. (14.61). Thus, the desire naturally arises to 
regard a magnetic field B as the curl of some vector field A — the vector potential 
of B. When solving the Maxwell equations, one passes to exactly such a vector 
potential. 


As can be seen from Definitions | and 6, the questions of the scalar and vector 
potential of vector fields (the latter question being posed only in R*) are special 
cases of the general question as to when a differential p-form a” is the differential 
dw?! of some form w?~!. 


Definition 7 A differential form w? is exact in a domain D if there exists a form 
w?—! in D such that w? =dw?—!. 


If the form w? is exact in D, then dw? = d2m?—! = 0. Thus the condition 
da =0 (14.62) 


is a necessary condition for the form w to be exact. 
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Fig. 14.5 


As we have already seen (Example 4), not every form satisfying this condition is 
exact. For that reason we make the following definition. 


Definition 8 The differential form @ is closed in a domain D if it satisfies condition 
(14.62) there. 


The following theorem holds. 
Theorem (Poincaré’s lemma) [fa form is closed in a ball, then it is exact there. 


Here we are talking about a ball in R” and a form of any order, so that Proposi- 
tion 2 is an elementary special case of this theorem. 

The Poincaré lemma can also be interpreted as follows: The necessary condition 
(14.62) for a form to be exact is also locally sufficient, that is, every point of a 
domain in which (14.62) holds has a neighborhood in which @ is exact. 

In particular, if a vector field B satisfies condition (14.61), it follows from the 
Poincaré lemma that at least locally it is the curl of some vector field A. 

We shall not take the time at this point to prove this important theorem (those 
who wish to do so can read it in Chap. 15). We prefer to conclude by explaining 
in general outline the connection between the problem of the exactness of closed 
forms and the topology of their domains of definition (based on information about 
1-forms). 


Example 6 Consider the plane IR? with two points p; and py removed (Fig. 14.5), 
and the paths yo, v1, and y2 whose supports are shown in the figure. The path y2 can 
be contracted to a point inside D, and therefore if a closed form @ is given in D, 
its integral over y2 is zero. The path yo cannot be contracted to a point, but without 
changing the value of the integral of the form, it can be homotopically converted 
into the path j;. 
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The integral over y; obviously reduces to the integral over one cycle enclosing 
the point p; clockwise and the double of the integral over a cycle enclosing p2 
counterclockwise. If 7; and 7> are the integrals of the form w over small circles 
enclosing the points p; and p2 and traversed, say, counterclockwise, one can see that 
the integral of the form @ over any closed path in D will be equal to n,T; + 127, 
where n; and nz are certain integers indicating how many times we have encircled 
each of the holes p; and pp in the plane R? and in which direction. 

Circles cj and cz enclosing p; and po serve as a sort of basis in which every 
closed path y C D has the form y = nic; +72C2, up to a homotopy, which has 
no effect on the integral. The quantities [ ¢, O = Tj are called the cyclic constants 
or the periods of the integral. If the domain is more complicated and there are k 
independent elementary cycles, then in agreement with the expansion y = njc, + 
--+ + nc, it results that ie @=nT, +---+nxTy. It turns out that for any set 


T,,..., 7; of numbers in such a domain one can construct a closed 1-form that will 
have exactly that set of periods. (This is a special case of de Rham’s theorem — see 
Chap. 15.) 


For the sake of visualization, we have resorted here to considering a plane do- 
main, but everything that has been said can be repeated for any domain D C R”. 


Example 7 In an anchor ring (the solid domain in R? enclosed by a torus) all closed 
paths are obviously homotopic to a circle that encircles the hole a certain number of 
times. This circle serves as the unique non-constant basic cycle c. 


Moreover, everything that has just been said can be repeated for paths of higher 
dimension. If instead of one-dimensional closed paths — mappings of a circle or, 
what is the same, mappings of the one-dimensional sphere — we take mappings 
of a k-dimensional sphere, introduce the concept of homotopy for them, and ex- 
amine how many mutually nonhomotopic mappings of the k-dimensional sphere 
into a given domain D C R” exist, the result is a certain characteristic of the do- 
main D which is formalized in topology as the so-called kth homotopy group of 
D and denoted 2;,(D). If all the mappings of the k-dimensional sphere into D are 
homotopic to a constant mapping, the group 2;(D) is considered trivial. (It con- 
sists of the identity element alone.) It can happen that zr; (D) is trivial and 22(D) is 
not. 


Example 8 If D is taken to be the space R* with the point 0 removed, obviously 
every closed path in D can be contracted to a point, but a sphere enclosing the 
point 0 cannot be homotopically converted to a point. 


It turns out that the homotopy group zr; (D) has less to do with the periods of a 
closed k-form than the so-called homology group H;(D). (See Chap. 15.) 


Example 9 From what has been said we can conclude that, for example, in the do- 
main R*\0 every closed 1-form is exact (IR>\0 is a simply connected domain), but 
not very closed 2-form is exact. In the language of vector fields, this means that 
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every irrotational field A in R°\0 is the gradient of a function, but not every source- 
free field B(div B = 0) is the curl of some field in this domain. 


Example 10 To balance Example 9 we take the anchor ring. For the anchor ring the 
group 77; (D) is not trivial (see Example 7), but z72(D) is trivial, since every mapping 
f : S* — D of the two-sphere into D can be contracted to a constant mapping (any 
image of a sphere can be contracted to a point). In this domain not every irrotational 
field is a potential field, but every source-free field is the curl of some field. 


14.3.6 Problems and Exercises 


1. Show that every central field A = f(r)r is a potential field. 
2. Let F = —gradU be a potential force field. Show that the stable equilibrium 
positions of a particle in such a field are the minima of the potential U of that field. 
3. For an electrostatic field E the Maxwell equations (formula (14.12) of Sect. 14.1), 
as already noted, reduce to the pair of equations V -E = a and V x E=0. 

The condition V x E=0 means, at least locally, that E = — grad. The field of 
a point charge is a potential field, and since every electric field is the sum (or inte- 
gral) of such fields, it is always a potential field. Substituting E = —V¢ in the first 
equation of the electrostatic field, we find that its potential satisfies Poisson’s equa- 
tion? Ag = a The potential g determines the field completely, so that describing 
E reduces to finding the function g, the solution of the Poisson equation. 

Knowing the potential of a point charge (Example 2), solve the following prob- 
lem. 


a) Two charges +q and —q are located at the points (0, 0, —d/2) and (0, 0, d/2) 
in R? with Cartesian coordinates (x, y,z). Show that at distances that are large 
relative to d the potential of the electrostatic field has the form 


1. Zz d+ 1 
So O| az], 
9 an eg r3 _ r3 
where r is the absolute value of the radius-vector r of the point (x, y, z). 
b) Moving very far away from the charges is equivalent to moving the charges 


together, that is, decreasing the distance d. If we now fix the quantity gd =: p and 


decrease d, then in the limit we obtain the function g = i 4 p in the domain 


IR3\0. It is convenient to introduce the vector p equal to p in absolute value and 
directed from —q to +q. We call the pair of charges —g and +q and the construction 
obtained by the limiting procedure just described a dipole, and the vector p the 


°§.D. Poisson (1781-1849) — French scientist, specializing in mechanics and physics; his main 
work was on theoretical and celestial mechanics, mathematical physics, and probability theory. 
The Poisson equation arose in his research into gravitational potential and attraction by spheroids. 
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dipole moment. The function ¢g obtained in the limit is called the dipole potential. 
Find the asymptotics of the dipole potential as one moves away from the dipole 
along a ray forming angle @ with the direction of the dipole moment. 

c) Let go be the potential of a unit point charge and g, the dipole potential 
having dipole moment p;. Show that g; = —(pi - V) go. 

d) We can repeat the construction with the limiting passage that we carried out 
for a pair of charges in obtaining the dipole for the case of four charges (more pre- 
cisely, for two dipoles with moments p; and p2) and obtain a quadrupole and a 
corresponding potential. In general we can obtain a multipole of order j with poten- 


7 , j J 
tial 9; = (-1)/ (pj - V)(Pj-1-V)--- (pi - V) go = paras ee Qin where 


Q} yy are the so-called components of the multipole moment. Carry out the com- 
putations and verify the formula for the potential of a multipole in the case of a 
quadrupole. 

e) Show that the main term in the asymptotics of the potential of a cluster of 
charges with increasing distance from the cluster is a 2 where Q is the total 
charge of the cluster. 

f) Show that the main term of the asymptotics of the potential of an electrically 
neutral body consisting of charges of opposite signs (for example, a molecule) at a 
distance that is large compared to the dimensions of the body is oa ee . Here e, 
is a unit vector directed from the body to the observer; p = > q;dj, where qj; is the 
magnitude of the ith charge and d; is its radius-vector. The origin is chosen at some 
point of the body. 

g) The potential of any cluster of charges at a great distance from the cluster 
can be expanded (asymptotically) in functions of multipole potential type. Show 
this using the example of the first two terms of such a potential (see d), e), and 


f)). 


4. Determine whether the following domains are simply connected. 


a) the disk {(x, y) € R?|x7+ y? < 1}; 

b) the disk with its center removed {(x, y) € R* |0 <x?+ y? <1}; 

c) a ball with its center removed {(x, y, z) € R3|O0<x7+ ye +27 <1}; 
d) an annulus {(x, y) € R? | 5 eae ¥y? <1}; 


e) aspherical annulus {(x, y, z) € R3 | 5 eat y? 4g? < 1}; 
f) an anchor ring in R?. 


5. a) Give the definition of homotopy of paths with endpoints fixed. 

b) Prove that a domain is simply connected if and only if every two paths in 
it having common initial and terminal points are homotopic in the sense of the 
definition given in part a). 


6. Show that 


a) every continuous mapping f : S! — S? of a circle S! (a one-dimensional 
sphere) into a two-dimensional sphere S? can be contracted in S? to a point (a 
constant mapping); 
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b) every continuous mapping f : S? > S! is also homotopic to a single point; 

c) every mapping f : S' + S! is homotopic to a mapping gy +> ng for some 
n €Z, where ¢ is the polar angle; 

d) every mapping of the sphere S$? into an anchor ring is homotopic to a mapping 
to a single point; 

e) every mapping of a circle S$! into an anchor ring is homotopic to a closed path 
encircling the hole in the anchor ring n times, for some n € Z. 


7. In the domain R*\0 (three-dimensional space with the point 0 removed) con- 
struct: 


a) aclosed but not exact 2-form; 
b) asource-free vector field that is not the curl of any vector field in that domain. 


8. a) Can there be closed, but not exact forms of degree p <n — 1 in the domain 
D = R"\0 (the space R” with the point 0 removed)? 
b) Construct a closed but not exact form of degree p =n — 1 in D=R"\0. 


9. If a 1-form w is closed in a domain D C R", then by Proposition 2 every point 
x € Dhas aneighborhood U (x) inside which @ is exact. From now on @ is assumed 
to be a closed form. 


a) Show that if two paths y; : [0,1] > D, i = 1,2, have the same initial and 
terminal points and differ only on an interval [a, 6] C [0, 1] whose image under 
either of the mappings y; is contained inside the same neighborhood U(x), then 
[p= Sy @- 

b) Show that for every path [0, 1] 5 tt» y(t) € D one can find a number 6 > 0 
such that if the path Y has the same initial and terminal point as y and differs from 
y at most by 6, that is maxg<;<1 |Y(t) — y(t)| < 4, then Jeo = i Oo. 

c) Show that if two paths y; and y2 with the same initial and terminal points are 
homotopic in D as paths with fixed endpoints, then [ yle= f. y22 for any closed 
form w in D. 


10. a) It will be proved below that every continuous mapping I”: I* > D of the 
square J” can be uniformly approximated with arbitrary accuracy by a smooth map- 
ping (in fact by a mapping with polynomial components). Deduce from this that if 
the paths y; and y2 in the domain D are homotopic, then for every ¢ > 0 there exist 
smooth mutually homotopic paths ; and 72 such that maxo<;<1 |¥j(t) — yi(t)| <e, 
i=1,2. 

b) Using the results of Example 9, show now that if the integrals of a closed 
form in D over smooth homotopic paths are equal, then they are equal for any paths 
that are homotopic in this domain (regardless of the smoothness of the homotopy). 
The paths themselves, of course, are assumed to be as regular as they need to be for 
integration over them. 


11. a) Show that if the forms w?, w?—!, and ©?—! are such that w? = dw?! = 
d@?—', then (at least locally) one can find a form w?~* such that @P~! = wP-! + 
dw?~?., (The fact that any two forms that differ by the differential of a form have the 
same differential obviously follows from the relation d*w = 0.) 
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b) Show that the potential g of an electrostatic field (Problem 3) is determined 
up to an additive constant, which is fixed if we require that the potential tend to zero 
at infinity. 


12. The Maxwell equations (formula (14.12) of Sect. 14.1) yield the following pair 
of magnetostatic equations: V -B = 0, V x B = ——4,. The first of these shows that 


Fe 
Egc~ 


0 
at least locally, B has a vector potential A, that is, B= V x A. 


a) Describe the amount of arbitrariness in the choice of the potential A of the 
magnetic field B (see Problem | 1a)). 

b) Let x, y, z be Cartesian coordinates in R>. Find potentials A for a uniform 
magnetic field B directed along the z-axis, each satisfying one of the following 
additional requirements: the field A must have the form (0, Ay, 0); the field A must 
have the form (Ax, 0,0); the field A must have the form (Ax, Ay, 0); the field A 
must be invariant under rotations about the z-axis. 

c) Show that the choice of the potential A satisfying the additional require- 
ment V - A = 0 reduces to solving Poisson’s equation; more precisely, to finding a 
scalar-valued function w satisfying the equation Ay = f for a given scalar-valued 
function f. 

d) Show that if the potential A of a static magnetic field B is chosen so that 
V-A=0, it will satisfy the vector Poisson equation AA = oe Thus, invoking 
the potential makes it possible to reduce the problem of finding electrostatic and 
magnetostatic fields to solving Poisson’s equation. 


13. The following theorem of Helmholtz'° is well known: Every smooth field F 
in a domain D of oriented Euclidean space RR? can be decomposed into a sum 
F =F, + F) of an irrotational field F, and a solenoidal field Fy. Show that the 
construction of such a decomposition can be reduced to solving a certain Poisson 
equation. 

14. Suppose a given mass of a certain substance passes from a state characterized 
thermodynamically by the parameters Vo, Po(7Zo) into the state V, P, (T). Assume 
that the process takes place slowly (quasi-statically) and over a path y in the plane of 
states (with coordinates V, P). It can be proved in thermodynamics that the quantity 
S= ff . 82 | where 5 Q is the heat exchange form, depends only on the initial point 
(Vo, Po) and the terminal point (V, P) of the path, that is, after one of these points is 
fixed, for example (Vo, Po), S becomes a function of the state (V, P) of the system. 
This function is called the entropy of the system. 


a) Deduce from this that the form w = 50 is exact, and that mw =dS. 


b) Using the form of 5Q given in Problem 6 of Sect. 13.1 for an ideal gas, find 
the entropy of an ideal gas. 


‘0H.L.F. Helmholtz (1821-1894) — German physicist and mathematician; one of the first to dis- 
cover the general law of conservation of energy. Actually, he was the first to make a clear distinction 
between the concepts of force and energy. 
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14.4 Examples of Applications 


To show the concepts we have introduced in action, and also to explain the physical 
meaning of the Gauss—Ostrogradskii—Stokes formula as a conservation law, we shall 
examine here some illustrative and important equations of mathematical physics. 


14.4.1 The Heat Equation 


We are studying the scalar field T = T (x, y, z, t) of the temperature of a body being 
observed as a function of the point (x, y, z) of the body and the time ¢. As a result 
of heat transfer between various parts of the body the field T may vary. However, 
this variation is not arbitrary; it is subject to a particular law which we now wish to 
write out explicitly. 

Let D be a certain three-dimensional part of the observed body bounded by a 
surface S. If there are no heat sources inside S, a change in the internal energy of 
the substance in D can occur only as the result of heat transfer, that is, in this case 
by the transfer of energy across the boundary S of D. 

By computing separately the variation in internal energy in the volume D and the 
flux of energy across the surface S, we can use the law of conservation of energy to 
equate these two quantities and obtain the needed relation. 

It is known that an increase in the temperature of a homogeneous mass m by 
AT requires energy cm AT, where c is the specific heat capacity of the substance 
under consideration. Hence if our field T changes by AT = T(x, y,z,t + At) — 
T(x, y, Z,t) over the time interval Ar, the internal energy in D will have changed 


by an amount 
II cpAT dV, (14.63) 
D 


where p = ¢(x, y, Z) is the density of the substance. 

It is known from experiments that over a wide range of temperatures the quantity 
of heat flowing across a distinguished area do = ndo per unit time as the result of 
heat transfer is proportional to the flux — grad T - do of the field — gradT across 
that area (the gradient is taken with respect to the spatial variables x, y, z). The 
coefficient of proportionality k depends on the substance and is called its coefficient 
of thermal conductivity. The negative sign in front of grad T corresponds to the fact 
that the energy flows from hotter parts of the body to cooler parts. Thus, the energy 
flux (up to terms of order o(A?)) 


At ff -kenar ao (14.64) 
Ss 


takes place across the boundary S of D in the direction of the external normal over 
the time interval Ar. 
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Equating the quantity (14.63) to the negative of the quantity (14.64), dividing 
by At, and passing to the limit as At —> 0, we obtain 


i 
II av = ff grad - a0, (14.65) 
Dot S 


This equality is the equation for the function 7. Assuming 7 is sufficiently 
smooth, we transform (14.65) using the Gauss—Ostrogradskii formula: 


oT : 
II os av = [ff div(k grad T) dV. 
p ot D 


Hence, since D is arbitrary, it follows obviously that 


oT 
Cary = div(k grad T). (14.66) 
We have now obtained the differential version of the integral equation (14.65). 
If there were heat sources (or sinks) in D whose intensities have density 
F(x, y,Z,t), instead of (14.65) we would write the equality 


II po av = ff kgradT -ao + fff Fdv, (14.65’) 
D ot A D 


and then instead of (14.66) we would have the equation 


oT 
Pa, = div(k grad T) + F. (14.66’) 
If the body is assumed isotropic and homogeneous with respect to its heat con- 
ductivity, the coefficient k in (14.66) will be constant, and the equation will trans- 
form to the canonical form 


oT 2 
ae AT +f, (14.67) 
_ Ff Do dees : : fi : 
where f = a and a“ = < is the coefficient of thermal diffusivity. The equation 
(14.67) is usually called the heat equation. 
In the case of steady-state heat transfer, in which the field T is independent of 
time, this equation becomes Poisson’s equation 


AT =¢, (14.68) 
where yg = — = Jf; and if in addition there are no heat sources in the body, the result 
is Laplace’s equation 

AT =0. (14.69) 


The solutions of Laplace’s equation, as already noted, are called harmonic 
functions. In the thermophysical interpretation, harmonic functions correspond to 
steady-state temperature fields in a body in which the heat flows occur without any 
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sinks or sources inside the body itself, that is, all sources are located outside the 
body. For example, if we maintain a steady temperature distribution T|gy = Tt over 
the boundary 0V of a body, then the temperature field in the body V will eventually 
stabilize in the form of a harmonic function 7. Such an interpretation of the solu- 
tions of the Laplace equation (14.69) enables us to predict a number of properties 
of harmonic functions. For example, one must presume that a harmonic function 
in V cannot have local maxima inside the body; otherwise heat would only flow 
away from these hotter portions of the body, and they would cool off, contrary to 
the assumption that the field is stationary. 


14.4.2 The Equation of Continuity 


Let p = p(x, y,z,t) be the density of a material medium that fills a space being 
observed and v = v(x, y, z, t) the velocity field of motion of the medium as function 
of the point of space (x, y, z) and the time f. 

From the law of conservation of mass, using the Gauss—Ostrogradskii formula, 
we can find an interconnection between these quantities. 

Let D be a domain in the space being observed bounded by a surface S. Over the 
time interval At the quantity of matter in D varies by an amount 


II (o(x, y,z,t + At) — p(x, y, z,t)) dV. 
D 


Over this small time interval At, the flow of matter across the surface S in the 
direction of the outward normal to S is (up to o(Afr)) 


ar ff pv-a0. 
Ss 


If there were no sources or sinks in D, then by the law of conservation of matter, 


we would have 
II Apav =—ar If pv- do 
D S 
or, in the limit as At > 0 
) 
II av =— ff pv-ao, 
p ot s 


Applying the Gauss—Ostrogradskii formula to the right-hand side of this equality 
and taking account of the fact that D is an arbitrary domain, we conclude that the 
following relation must hold for sufficiently smooth functions p and v: 

ap 


—- div(pv), (14.70) 


called the equation of continuity of a continuous medium. 
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In vector notation the equation of continuity can be written as 


0 
oA +V-(pv) =0, (14.70) 
or, in more expanded form, 
dp " 
apt Ve ey v= (14.70”) 


If the medium is incompressible (a liquid), the volumetric outflow of the medium 
across a closed surface S must be zero: 


|] v=o 
RY 


from which (again on the basis of the Gauss—Ostrogradskii formula) it follows that 
for an incompressible medium 


divv =0. (14.71) 


Hence, for an incompressible medium of variable density (a mixture of water and 
oil) Eq. (14.70) becomes 
0p 


—+y-Vp=0. 14.72 
ae p ( ) 


If the medium is also homogeneous, then Vp = 0 and therefore op =0. 


14.4.3: The Basic Equations of the Dynamics of Continuous Media 


We shall now derive the equations of the dynamics of a continuous medium moving 
in space. Together with the functions p and v already considered, which will again 
denote the density and the velocity of the medium at a given point (x, y, z) of space 
and at a given instant ¢ of time, we consider the pressure p = p(x, y,Z,f) as a 
function of a point of space and time. 

In the space occupied by the medium we distinguish a domain D bounded by a 
surface S and consider the forces acting on the distinguished volume of the medium 
at a fixed instant of time. 

Certain force fields (for example, gravitation) are acting on each element p dV 
of mass of the medium. These fields create the so-called mass forces. Let F = 
F(x, y, z, t) be the density of the external fields of mass force. Then a force Fo dV 
acts on the element from the direction of these fields. If this element has an acceler- 
ation a at a given instant of time, then by Newton’s second law, this is equivalent to 
the presence of another mass force called inertia, equal to —ap dV. 

Finally, on each element do = ndo of the surface S there is a surface tension 
due to the pressure of the particles of the medium near those in D, and this surface 
force equals — p do (where n is the outward normal to S). 


14.4 Examples of Applications 307 


By d’Alembert’s principle, at each instant during the motion of any material sys- 
tem, all the forces applied to it, including inertia, are in mutual equilibrium, that is, 
the force required to balance them is zero. In our case, this means that 


|i w-a)pav - | pas =o. (14.73) 
D S 


The first term in this sum is the equilibrant of the mass and inertial forces, and 
the second is the equilibrant of the pressure on the surface S$ bounding the volume. 
For simplicity we shall assume that we are dealing with an ideal (nonviscous) fluid 
or gas, in which the pressure on the surface do has the form p do, where the number 
p is independent of the orientation of the area in the space. 

Applying formula (14.47) from Sect. 14.2, we find by (14.73) that 


|i (-aypav — fff grad pdv=0, 
D D 


from which, since the domain D is arbitrary, it follows that 
pa= pF — grad p. (14.74) 


In this local form the equation of motion of the medium corresponds perfectly to 
Newton’s law of motion for a material particle. 

The acceleration a of a particle of the medium is the derivative e of the velocity 
v of the particle. If x = x(t), y = y(t), z = z(t) is the law of motion of a particle 
in space and v = v(x, y,z,f) is the velocity field of the medium, then for each 


individual particle we obtain 


dv Ov Ae dvdy dvdz 
dt dt dxdt dydt dzdt 


or 


dv 
=— -V)v. 
a apt )v 


Thus the equation of motion (14.74) assumes the following form 


dv 1 
— =F-— ~— grad p (14.75) 
dt p 
or 
Ov 1 
—+(v-V)v=F-—Vp. (14.76) 
ot p 


Equation (14.76) is usually called Euler’s hydrodynamic equation. 

The vector equation (14.76) is equivalent to a system of three scalar equations 
for the three components of the vector v and the pair of functions p and p. 

Thus, Euler’s equation does not completely determine the motion of an ideal 
continuous medium. To be sure, it is natural to adjoin to it the equation of continuity 
(14.70), but even then the system is underdetermined. 
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To make the motion of the medium determinate one must also add to Eqs. (14.70) 
and (14.76) some information on the thermodynamic state of the medium (for ex- 
ample, the equation of state f(p, o, T) =0 and the equation for heat transfer). The 
reader may obtain some idea of what these relations can yield in the final subsection 
of this section. 


14.4.4 The Wave Equation 


We now consider the motion of a medium corresponding to the propagation of an 
acoustic wave. It is clear that such a motion is also subject to Eq. (14.76); this 
equation can be simplified due to the specifics of the phenomenon. 

Sound is an alternating state of rarefaction and compression of a medium, the 
deviation of the pressure from its mean value in a sound wave being very small — 
of the order of 1 %. Therefore acoustic motion consists of small deviations of the 
elements of volume of the medium from the equilibrium position at small velocities. 
However, the rate of propagation of the disturbance (wave) through the medium is 
comparable with the mean velocity of motion of the molecules of the medium and 
usually exceeds the rate of heat transfer between the different parts of the medium 
under consideration. Thus, an acoustic motion of a volume of gas can be regarded 
as small oscillations about the equilibrium position occurring without heat transfer 
(an adiabatic process). 

Neglecting the term (v- V)v in the equation of motion (14.76) in view of the 
small size of the macroscopic velocities v, we obtain the equality 


dv 
—=pF-Vp. 
Pa =P P 


If we neglect the term of the form SP y for the same reason, the last equality 
reduces to the equation 


0 
— (pv) = pF-—Vp. 
yee P 
Applying the operator V (on x, y, z coordinates) to it, we obtain 
0 
ap PMH v - pF — Ap. 


Using the equation of continuity (14.70’) and introducing the notation V - pF = 
—®@, we arrive at the equation 


—" _@+Ap. (14.77) 


ap 
ar? 
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If we can neglect the influence of the exterior fields, Eq. (14.77) reduces to the 
relation 

ap 

are 

between the density and pressure in the acoustic medium. Since the process is adi- 

abatic, the equation of state f(p, 0, T) = 0 reduces to a relation p = y(p), from 

which it follows that ay =wW'(p) ep +w’(p) (2p Since the pressure oscillations 

are small in an acoustic wave, one may assume that y’(p) = w’(po), where po is the 


= Ap (14.78) 


equilibrium pressure. Then w” = 0 and op 2 w'( pee. Taking this into account, 
from (14.78) we finally obtain 


oP =a Ap, (14.79) 


where a = (y'( po)! 2. This equation describes the variation in pressure in a 
medium in a state of acoustic motion. Equation (14.79) describes the simplest wave 
process in a continuous medium. It is called the homogeneous wave equation. The 
quantity a has a simple physical meaning: it is the speed of propagation of an acous- 
tic disturbance in the medium, that is, the speed of sound in it (see Problem 4). 

In the case of forced oscillations, when certain forces are acting on each element 
of volume of the medium, the three-dimensional density of whose distribution is 
given, Eq. (14.79) is replaced by the relation 

ap 


ee a’ Ap+f (14.80) 


corresponding to Eq. (14.77), which for f #0 is called the inhomogeneous wave 
equation. 


14.4.5 Problems and Exercises 


1. Suppose the velocity field v of a moving continuous medium is a potential field. 
Show that if the medium is incompressible, the potential g of the field v is a har- 
monic function, that is, Ag = 0 (see (14.71). 

2. a) Show that Euler’s equation (14.76) can be rewritten as 


Ov 


1 1 
+ end( 51") —vxcurlv=F — — grad p 
ot p 


2 
(see Problem 1 of Sect. 14.1). 

b) Verify on the basis of the equation of a) that an irrotational flow (curl v = 0) 
of a homogeneous incompressible liquid can occur only in a potential field F. 

c) It turns out (Lagrange’s theorem) that if at some instant the flow in a po- 
tential field F = grad U is irrotational, then it always has been and always will be 
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irrotational. Such a flow consequently is at least locally a potential flow, that is, 
v = grad @. Verify that for a potential flow of a homogeneous incompressible liquid 
taking place in a potential field F, the following relation holds at each instant of 
time: 


dp vp 
radj —+—+-—-U)]=0. 
: ( ot 3 2 / 
d) Derive the so-called Cauchy integral from the equality just obtained: 


0 

a +5 =a ae —~-U=®9(t), 

ot p 

a relation that asserts that the left-hand side is independent of the spatial coordinates. 
e) Show that if the flow is also steady-state, that is, the field v is independent of 

time, the following relation holds 


2 
v 
Le aes ee 


2 p 
called the Bernoulli integral. 


3. A flow whose velocity field has the form v = (vx, vy, 0) is naturally called plane- 
parallel or simply a planar flow. 


a) Show that the conditions div v = 0, curl v = 0 for a flow to be incompressible 
and irrotational have the following forms: 


Ovy OVy OU, — dVy 
ox dy 


dy dx 

b) Show that these equations at least locally guarantee the existence of functions 
w(x, y) and g(x, y) such that (—vy, v,) = grad w and (v,, vy) = gradg. 

c) Verify that the level curves g = c; and y = c2 of these functions are orthogo- 
nal and show that in the steady-state flow the curves yw = c coincide with the trajec- 
tories of the moving particles of the medium. It is for that reason that the function 
w is called the current function, in contrast to the function g, which is the velocity 
potential. 

d) Show, assuming that the functions g and y are sufficiently smooth, that they 
are both harmonic functions and satisfy the Cauchy—Riemann equations: 


dp dy ap ow 


Harmonic functions satisfying the Cauchy—Riemann equations are called conjugate 
harmonic functions. 

e) Verify that the function f(z) = (g +iw)(x, y), where z= x + iy, is a dif- 
ferentiable function of the complex variable z. This determines the connection of 
the planar problems of hydrodynamics with the theory of functions of a complex 
variable. 


14.4 Examples of Applications 311 
4. Consider the elementary version cy P= as ik 5 of the wave equation (14.79). This 
is the case of a plane wave in which the Srescure depends only on the x-coordinate 
of the point (x, y, z) of space. 


a) By making the change of variable u = x — at, v = x +at, reduce this equation 


to the form XP = = 0 and show that the general form of the solution of the original 
equation is p = f(x + at) + g(x — at), where f and g are arbitrary functions of 
class C®), 

b) Interpret the solution just obtained as two waves f(x) and g(x) propagating 
left and right along the x-axis with velocity a. 

c) Assuming that the quantity a is the velocity of propagation of a distur- 
bance even in the general case (14.79), and taking account of the relation a = 
(w’ (po))~"/ 2 find, following Newton, the velocity cy of sound in air, assuming 
that the temperature in an acoustic wave is constant, that is, assuming that the 
sae of te oscillation is isothermic. (The equation of pe is p = ae 

= 8.31 eel ae is the universal gas constant, and = 28.8 anart is the molec- 
os weight of air. Carry out the computation for air at a temperature of 0 °C, that 
is, T = 273 K. Newton found that cy = 280 m/s.) 

d) Assuming that the process of acoustic vibrations is adiabatic, find, following 
Laplace, the velocity cy, of sound in air, and thereby sharpen Newton’s result cy. 
(In an adiabatic process p = cp’. This is Poisson’s formula from Problem 6 of 
Sect. 13.1. Show that if cy = J then cy, = re For air y © 1.4. Laplace found 


cy = 330 m/s, which is in excellent agreement with experiment.) 


5. Using the scalar and vector potentials one can reduce the Maxwell equations 
((14.12) of Sect. 14.1) to the wave equation (more precisely, to several wave equa- 
tions of the same type). By solving this problem, you will verify this statement. 


a) It follows from the equation V - B = 0 that at least locally B= V x A, where 
A is the vector potential of the field B. 
b) Knowing that B = V x A, show that the equation V x E= — 3B implies that 


at least locally there exists a scalar a yg such that E = —Vog — ps 
c) Verify that the fields E= —Vg — = A and B=V x Ado not dine if instead 
of g and A we take another pair of Sienaalee g and A such that % Q=o- ay and 


A=A+ Vw, where y is an arbitrary function of class C®. 

d) The equation V -E= implies the first relation —V7y — ev -A= a 
between the potentials g and . 

e) The equation c?V x B— = =; implies the second relation 


2 


0 0 
272 2 

—c VA V(V-A V = 
c + c°V( aa gt+ 52 ke 


between the potentials g and A. 
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f) Using c), show that by solving the auxiliary wave equation Ay + f = 5 ay , 
without changing the fields E and B one can choose the potentials g and A so that 
they satisfy the additional (so-called gauge) condition V-A = — 5 
g) Show that if the potentials g and A are chosen as stated in f), then the required 
inhomogeneous wave equations 
ry 9 pc vA 9 J 
pane —— — =cAA+ — 
at? ; E0 at? c - E0 
for the potentials g and A follow from d) and e). By finding g and A, we also find 
the fields E= Vo, B=V x A. 


Chapter 15 
*Integration of Differential Forms on Manifolds 


15.1 A Brief Review of Linear Algebra 


15.1.1 The Algebra of Forms 


Let X be a vector space and F* : X* -s R a real-valued k-form on X. If €1,---5,€n 
is a basis in X and x; = x'le;,, rie Xe = x'kej, is the expansion of the vectors 
X1,...,X% € X with respect to this basis, then by the linearity of F k with respect to 
each argument 


Faisal SP exp cnt eR) — 


= F¥(e;,,...,€;,)x!! ee = dj,..i,X"! exe (15.1) 


Thus, after a basis is given in X, one can identify the k-form F Kk. Xk _, R with 


the set of numbers aj, __i, = Frei, wecnip ei) 
If él, ...,@, 18 another basis in X and aj,...j, = FKé;,, ...,@;,), then, setting 
ej= ciei, j=l1,...,n, we find the (tensor) law 
~ pki. kk. \— 7. rll. . pbk 
Qj,...j, = F (ci) ei, Seats ct ei) ae (15.2) 


for transformation of the number sets aj,__i,,@j,...;, Corresponding to the same 
form F*. 

The set F* := {Pes xs R} of k-forms on a vector space X is itself a vector 
space relative to the standard operations 


(FE + FE)(x) = FRx) + FQ), (15.3) 
(AF*)(x) = AFF(x) (15.4) 

of addition of k-forms and multiplication of a k-form by a scalar. 
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For forms F* and F! of arbitrary degrees k and / the following tensor product 
operation ® is defined: 


FOF Gis. et tease) 


= FF(x1,..., x) F! xey1y 0s Ket): (15.5) 


Thus F* @ F! is aform F**! of degree k+/. The following relations are obvious: 


(AF) @ Fi =1(F* @ F'), (15.6) 
(i+ Py)er=Fer+FeF', (15.7) 
F@(Fi+K)=F@r+F oF, (15.8) 
(F« @ F')@ F™ = F* @(F'@ F”). (15.9) 


Thus the set F = {F"} of forms on the vector space X is a graded algebra F = 
@, F* with respect to these operations, in which the vector-space operations are 
carried out inside each space F* occurring in the direct sum, and if F* ¢ F*, F! € 
F’, then F* @ Fl e FR, 


Example I Let X* be the dual space to X (consisting of the linear functionals on X) 
and e!,..., e” the basis of X* dual to the basis e1,..., én in X, that is, e (ej)= 5i. 
Since e! (x) = e!(x/e;) = xJe!(ej) = xI5i = x', taking account of (15.1) and 


(15.9), we can write any k-form FFE: Xk - Ras 


FR =a; 4,e'@---@e. (15.10) 


15.1.2 The Algebra of Skew-Symmetric Forms 


Let us now consider the space 2* of skew-symmetric forms in F*, that is, w € 2* 
if the equality 


OK y os eg Apps oe Lipp eces XE) = HO ys 05 Kjy ees Mig oe KE) 
holds for any distinct indices i, j € {1,...,n}. 


From any form F* € F* one can obtain a skew-symmetric form using the oper- 
ation A: F — Q* of alternation, defined by the relation 


1 Si 
AF* (x1, w= PTGae re to, (15.11) 
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where 
1, if the permutation (‘ i) is even, 
Silk — 3 1. if the permutation JS ec 
Lk ’ 1 «--- k ? 
0, if G - iy is not a permutation. 


If F* isa skew-symmetric form, then, as one can see from (15.11), AF‘ = F*, 
Thus A(AF*) = AF* and Aw = a if w € Q*. Hence A: F* > Q* is a mapping 
of F* onto Qk. 

Comparing Definitions (15.3), (15.4), and (15.11), we obtain 


A(FE + FE) = AFE + AFF, (15,12) 
A(AF*) = AAF*. (15.13) 


Example 2 Taking account of relations (15.12) and (15.13), we find by (15.10) that 
AF* =aj,_..i, A(e! ®--- @e'*), 


so that it is of interest to find A(e’! @--- @ e’*). 
From Definition (15.11), taking account of the relation e! (x) = x', we find 


A(e!! @- @ek)(xy, Ley Kk) = 


1, see 
= pe Hi) Skat eFk (xj, 84 = 
1 , ee sa xi 
J fogtcs a. 
Tata Re] EGY: (15.14) 
re a xf 


The tensor product of skew-symmetric forms is in general not skew-symmetric, 
so that we introduce the following exterior product in the class of skew-symmetric 
forms: 


k+1)! 
io 
kl! 


A(ok @ a’). (15.15) 


Thus w* A w! is a skew-symmetric form w*t! of degree k + 1. 
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Example 3 Based on the result (15.14) of Example 2, we find by Definition (15.15) 
that 


; : 2! F . 
e" Ae? (x1, x2) = ——A(e"! @e”) (1, x2) = 


1! 
iy i2 xl! x! 

Beg eee ec ea (15.16) 
en) e(m)| “| yf xb 


Example 4 Using the equality obtained in Example 3, relation (15.14), and the def- 
initions (15.11) and (15.15), we can write 


ell A (e”2 A e'3) (x1, x2, X3) — 


(+2)! 7, ; . ; 
_ 1 in i3 = 
mIRC A(e'! @ (e? @e'3)) (1, x23) = 
3) 1 i2 xB 
— 2 ot. \(ol2 pn 0l3\(r. 7.) sities — 2 yh OR OR) sib 
= i? (xj, )(e Ae Ge 3 = oie ‘ i3 6133 = 
tZ! : Be a XxX: 
3 
iz i3 i2 13 i2 i3 
iy [42 XQ i (%r  %4 i \% *r | 
=X : : x : | +x : lh 
1 in i3 2 in i3 in i3 
X30 X3 %3 %3 Hoy AQ 
i in 13 
My hy ty 
re in 13 
Teo” eg eg 
i 12 13 
%3 X30 3 
A similar computation shows that 
ela (e”? A e') = (e"! A e’”) Ae, (15.17) 


Using the expansion of the determinant along a column, we conclude by induc- 
tion that 


e(xy) +++ elk(x1) 
eA -Aek(x1,...,u)=|  : _ e | (15.18) 
e(xg) = el (xe) 
and, as one can see from the computations just carried out, formula (15.18) holds 
for any 1-forms e'!, ..., e’* (not just the basis forms of the space X*). 


Taking the properties of the tensor product and the alternation operation listed 
above into account, we obtain the following properties of the exterior product of 
skew-symmetric forms: 


(of +05) Aa! = ak Aa! +05 Aa, (15.19) 


(Aw) Aa! =a(ok ro’), (15.20) 
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of Aa! = (-1)a! Ao, (15.21) 


(o* A ow) Awa™ =a A (o! A wo”). (15.22) 


Proof Equalities (15.19) and (15.20) follow obviously from relations (15.6)—(15.8) 
and (15.12) and (15.13). 

From relations (15.10)—(15.14) and (15.17), for every skew-symmetric form w = 
diy.ize! @---@e'* we obtain 


a= Aw= diy...i, A(e"! ®-:-@ ek) = oi ine AvsAek, 
Using the equalities (15.19) and (15.20) we see that it now suffices to verify 
(15.21) and (15.22) for the forms e!! A--- A el, 
Associativity (15.22) for such forms was already established by (15.17). 
We now obtain (15.21) immediately from (15.18) and the properties of determi- 
nants for these particular forms. 


Along the way we have shown that every form w € Q* can be represented as 


o= > di,..ipell Avo Ne, (15.23) 


1 <i <ig<++<ig<n 


Thus, the set 2 = {2*} of skew-symmetric forms on the vector space X relative 
to the linear vector-space operations (15.3) and (15.4) and the exterior multiplication 
(15.15) is a graded algebra 2 = aa 9Q*. The vector-space operations on Q are 
carried out inside each vector space Q*, and if w* € Qk, aw! € 2, then wo Aale 
Qk! . 

In the direct sum @2* the summation runs from zero the dimension of the 
space X, since the skew-symmetric forms w* : X* — R of degree larger than the 
dimension of X are necessarily identically zero, as one can see by (15.21) (or from 
relations (15.23) and (15.8)). 


15.1.3 Linear Mappings of Vector Spaces and the Adjoint 
Mappings of the Conjugate Spaces 


Let X and Y be vector spaces over the field R of real numbers (or any other field, so 
long as it is the same field for both X and Y), and let / : X — Y bea linear mapping 
of X into Y, that is, for every x, x1,x2 € X and every A € R, 


L(y + x2) =1(x1) + 1x2) and (Ax) = Al(x). (15.24) 


A linear mapping / : X — Y naturally generates its adjoint mapping /* : Fy > 
Fx from the set of linear functionals on Y(Fy) into the analogous set Fy. If F is is 
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a k-form on Y, then by definition 
(PPE) gs) — Be Otiscagl ae (15.25) 


It can be seen by (15.24) and (15.25) that LFS is a k-form FE on X, that is, 
l* FF) CF a Moreover, if the form Fk was skew-symmetric, then (I* FX) =F : is 
also skew-symmetric, that is, / *LQe) Cc a, Inside each vector space F; : and pe 
the mapping /* is obviously linear, that is, 


PFE +R) =P RE + RE and I*(AF*) alt F*. (15.26) 


Now comparing definition (15.25) with the definitions (15.5), (15.11), and 
(15.15) of the tensor product, alternation, and exterior product of forms, we con- 
clude that 


I*(F? @ F2) = (I*F?) @ (I* F4), (15.27) 
(AF?) = A(*F?), (15.28) 
I*(w? Ao!) = (lw PA (I*o"). (15.29) 
Example 5 Let €],...,@m be a basis in X, €1,...,@, a basis in Y, and l(e;) = 
cl é;, ie{l,...,m},j €({l,...,a}. Ifthe k-form FE has the coordinate representa- 
tion 
FE(y1, 0-5 9) = bj. toa. aa 
in the basis é;,..., @), where bj, j, = FKE;, ...,@;,), then 
(* FY) (x1, say MES Ohne Sct ‘a, 
where dj,...i, = By .y Cr Scena eri since 
—. (7* pk -_ pk = 
Qi... I“ F Yea: Aeey €i,) = Fy (lei, , ees léj,) = 
k (ad kes ~ J Jk 
= Fy(CHéj,..., Cz re, = Py Chaengeg Jer tae Gr 
Example 6 Let e!,...,e” and é! .,é” be the bases of the conjugate spaces X* 


and Y* dual to the panes in Peample 5. Under the hypotheses of Example 5 we 
obtain 


(I*2/) (x) = (*é/)(x!e;) = 6) (x'le;) =x!G) (ck ex) = 


= xi ckel (ek) = x of? = oe = re e! (x). 


Example 7 Retaining the notation of Example 6 and taking account of relations 
(15.22) and (15.29), we now obtain 
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P(E A. Ae) = PEN A. Ae = 


_ (Ai coe Jk nik) A. . Jk it coe ik 
= (cle) A---A (ce) Sept +... cet A--- Age = 
J Jk 
Ciy ee Ci 
— ) Pte fell Arne, 
1Si)<--<igsm | jy clk 


ix ik 


Keeping Eq. (15.26) in mind, we can conclude from this that 


r( ae avi nght) = 


I< jy <-+<jgSn 


A dk 
Ci, Ci, 
- . : il ik 
a ) Dj, +++ dk elA.-Aek= 
1S<ij <+--<ip<m vl Jk 
I<ji<-<igsm Cy PEt Gy 


= ) Gig | Av Ae, 


1Si| <:-<ip<m 


15.1.4 Problems and Exercises 


1. Show by examples that in general 
a) F@FSZF'@F'; 
b) ACF. @ F!) 4 AF‘ @ AF'; 
c) if FE, F! € 9, then it is not always true that Fr@kleg. 


2. a) Show that if e],...,e, is a basis of the vector space X and the linear func- 
tionals e!,...,e” on X (that is elements of the conjugate space X*) are such that 
el(e;)= as then e!,...,e” is a basis in X*. 


b) Verify that one can always form a basis of the space F* = F*(X) from k- 
forms of the form e!! @ --- @ e*, and find the dimension (dim F*) of this space, 
knowing that dim X =n. 

c) Verify that one can always form a basis of the space 2* from forms of the 
form e!! A--- A elk, and find dim Q* knowing that dim X =n. 

d) Show that if 2 = oO. Q*, then dim 2 = 2". 


3. The exterior (Grassmann)! algebra G over a vector space X and a field P (usu- 
ally denoted /\(X) in agreement with the symbol A for the multiplication operation 


'H. Grassmann (1809-1877) — German mathematician, physicist and philologist; in particular, he 
created the first systematic theory of multidimensional and Euclidean vector spaces and gave the 
definition of the inner product of vectors. 
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in G) is defined as the associative algebra with identity | having the following prop- 
erties: 

1° G is generated by the identity and X, that is, any subalgebra of G containing 
1 and X is equal to G; 

2° x Ax =0 for every vector x € X; 

adie =O 


a) Show that if e,,...,e@, is a basis in X, then the set 1, e1,...,@),e1 A 
€2,-++,€n—-1 AN€n, «++, €1 N***A €n Of elements of G of the form e;, A--- A ei, = e7, 
where I = {ij <--- <i} C {1,2,...,}, forms a basis in G. 


b) Starting from the result in a) one can carry out the following formal construc- 
tion of the algebra G = /\(X). 

For the subsets J = {i1,..., iz} of {1,2,...,} shown in a) we form the formal 
elements e7, (by identifying e;;; with e;, and eg with 1), which we take as a basis of 
the vector space G over the field P. We define multiplication in G by the formula 


(y ares) (x bye1) = \larbye(l, Des, 
I J LJ 


where e(/, J) = sgn Tier jesG — i). Verify that the Grassmann algebra /\(X) is 
obtained in this way. 

c) Prove the uniqueness (up to isomorphism) of the algebra /\(X). 

d) Show that the algebra /\(X) is graded: A(X) = Os, APR; where 
A‘ (X) is the linear span of the elements of the form e;, A --- A é,; here if a € 
A? (X) and b € A\4(X), thena Abe A\?*4(X). Verify that aA b = (—1)%b Aa. 


4. a) Let A: X — Y bea linear mapping of X into Y. Show that there exists a 
unique homomorphism /\(A) : \(X) > /A\(Y) from /A\(X) into /\(Y) that agrees 
with A on the subspace /\'(X) C /\(X) identified with X. 


b) Show that the homomorphism /\(A) maps MS (X) into NW ). The restric- 
tion of /(\(A) to \\*(X) is denoted by (*(A). 

c) Let {e;: i =1,...,m} be a basis in X and {e;: j = 1,...,n} a basis in Y, 
and let the matrix (a) correspond to the operator A in these bases. Show that if 
fey: 1 C{l,...,m}}, fey: J C {1,...,}} are the corresponding bases of the spaces 
/\(X) and /\(Y), then the matrix of the operator A‘ (A) has the form a i = det(a‘), 
ie l,j ¢J, where card / =cardJ =k. 

d) Verify that if A: X — Y,B: Y — Z are linear operators, then the equality 
/\(B 0 A) = A\(B) 0 A\(A) holds. 
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15.2 Manifolds 


15.2.1 Definition of a Manifold 


Definition 1 A Hausdorff topological space whose topology has a countable base” 
is called an n-dimensional manifold if each of its points has a neighborhood U 
homeomorphic either to all of R” or to the half-space H” = {x € R” | x! < 0}. 


Definition 2 A mapping g: R” — U C M (or g: H” > U C M) that realizes the 
homeomorphism of Definition | is a local chart of the manifold M, IR” (or H") is 
called the parameter domain, and U the range of the chart on the manifold M. 


A local chart endows each point x € U with the coordinates of the point tf = 
g '(x) € R" corresponding to it. Thus, a local coordinate system is introduced in 
the region U;; for that reason the mapping 9, or, in more expanded notation, the pair 
(U, ~) is a map of the region U in the ordinary meaning of the term. 


Definition 3 A set of charts whose ranges taken together cover the entire manifold 
is called an atlas of the manifold. 


Example 1 The sphere S? = {x € R? | |x| = 1} is a two-dimensional manifold. If 
we interpret S* as the surface of the Earth, then an atlas of geographical maps will 
be an atlas of the manifold S?. 

The one-dimensional sphere S$! = {x € R? | |x| = 1} — a circle in R? — is obvi- 
ously a one-dimensional manifold. In general, the sphere S$” = {x € R’+! | |x} = 1} 
is an n-dimensional manifold. (See Sect. 12.1.) 


Remark 1 The object (the manifold M) introduced by Definition | obviously does 
not change if we replace R” and H” by any parameter domains in R” homeomor- 
phic to them. For example, such a domain might be the open cube 7” = {x € R” | 


O<xi <1li= 1,...,m} and the cube with a face attached P= {x € R” |0< 
x! <1,0<x' <1,i=2,...,n}. Such standard parameter domains are used quite 
often. 


It is also not difficult to verify that the object introduced by Definition 1 does 
not change if we require only that each point x € M have a neighborhood U in M 
homeomorphic to some open subset of the half-space H”. 


Example 2 If X is anm-dimensional manifold with an atlas of charts {(Ug, @y)} and 
Y is ann-dimensional manifold with atlas {(Vg, Wg)}, then X x Y can be regarded as 
an (m + n)-dimensional manifold with the atlas {(Wog, Xag)}, where Wag = Uy x 
Vg and the mapping Xag = (Ya, Wg) maps the direct product of the domains of 
definition of gy and wg into Woz. 


>See Sect. 9.2 and also Remarks 2 and 3 in the present section. 
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Fig. 15.1 


In particular, the two-dimensional torus T? = S$! x §! (Fig. 12.1) or the n-di- 

mensional torus T” = S$! x --- x S! is a manifold of the corresponding dimension. 
n factors 

If the ranges U; and U; of two charts (U;, y;) and (U;, @;) of a manifold M in- 
tersect, that is, U; 1 U; #4 @, mutually inverse homeomorphisms ¢j; : [ij > Ij; and 
yji + 1j; > Ij; naturally arise between the sets J;; = yg, '(Uj) and Jj; = g; '(Ui). 
These homeomorphisms are given by 9;; = 9; ° gly, and pj; = 9; | © Pil iji- 
These homeomorphisms are often called changes of coordinates, since they effect 
a transition from one local coordinate system to another system of the same kind in 
their common range U; 1 Uj; (Fig. 15.1). 


Definition 4 The number n in Definition | is the dimension of the manifold M and 
is usually denoted dim M. 


Definition 5 If a point g~'(x) on the boundary 3H” of the half-space H” corre- 
sponds to a point x € U under the homeomorphism ¢ : H” — U, then x is called 
a boundary point of the manifold M (and of the neighborhood U). The set of all 
boundary points of a manifold M is called the boundary of this manifold and is 
usually denoted 0M. 


By the topological invariance of interior points (Brouwer’s theorem*) the con- 
cepts of dimension and boundary point of a manifold are unambiguously defined, 
that is, independent of the particular local charts used in Definitions 4 and 5. We 
have not proved Brouwer’s theorem, but the invariance of interior points under dif- 
feomorphisms is well-known to us (a consequence of the inverse function theorem). 
Since it is diffeomorphisms that we shall be dealing with, we shall not digress here 
to discuss Brouwer’s theorem. 


3This theorem asserts that under a homeomorphism gy : E > g(£) of a set E C R” onto a set 
y(E) C R" the interior points of E map to interior points of g(E). 
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Fig. 15.2 


Example 3 The closed ball B= {x € R” | |x| < 1} or, as we say, the n-dimensional 
disk, is an n-dimensional manifold whose boundary is the (” — 1)-dimensional 
sphere S"—! = {x € R” | |x| = 1}. 


Remark 2. A manifold M having a nonempty set of boundary points is usually called 
a manifold with boundary, the term manifold (in the proper sense of the term) be- 
ing reserved for manifolds without boundary. In Definition | these cases are not 
distinguished. 


Proposition 1 The boundary 0M of an n-dimensional manifold with boundary M 
is an (n — 1)-dimensional manifold without boundary. 


Proof Indeed, 0H” = R"—!, and the restriction to 0H” of a chart of the form q; : 
H” — U; belonging to an atlas of M generates an atlas of 0M. 


Example 4 Consider the planar double pendulum (Fig. 15.2) with arm a shorter 
than arm b, both being free to oscillate, except that the oscillations of b are limited in 
range by barriers. The configuration of such a system is characterized at each instant 
of time by the two angles a and f. If there were no constraints, the configuration 
space of the double pendulum could be identified with the two-dimensional torus 
T? = Sx x Sp. 

Under these constraints, the configuration space of the double pendulum is 
parametrized by the points of the cylinder Ss) x I ce where Ne is the circle, corre- 


sponding to all possible positions of the arm a, and I} = {8 € R | |B| < A} is the 
interval within which the angle 6 may vary, characterizing the position of the arm b. 

In this case we obtain a manifold with boundary. The boundary of this manifold 
consists of the two circles si x {—A} and er x {A}, which are the products of the 
circle si and the endpoints {— A} and {A} of the interval J Be 


Remark 3 It can be seen from Example 4 just considered that coordinates some- 
times arise naturally on M (q@ and # in this example), and they themselves induce a 
topology on M. Hence, in Definition 1 of a manifold, it is not always necessary to 
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require in advance that M have a topology. The essence of the concept of a manifold 
is that the points of some set M can be parametrized by the points of a set of sub- 
domains of R”. A natural connection then arises between the coordinate systems 
that thereby arise on parts of M, expressed in the mappings of the corresponding 
domains of IR”. Hence we can assume that M is obtained from a collection of do- 
mains of R” by exhibiting some rule for identifying their points or, figuratively 
speaking, exhibiting a rule for gluing them together. Thus defining a manifold es- 
sentially means giving a set of subdomains of R” and a rule of correspondence for 
the points of these subdomains. We shall not take the time to make this any more 
precise by formalizing the concept of gluing or identifying points, introducing a 
topology on M, and the like. 


Definition 6 A manifold is compact (resp. connected) if it is compact (resp. con- 
nected) as a topological space. 


The manifolds considered in Examples 1-4 are compact and connected. The 
boundary of the cylinder s) x1 3 in Example 4 consists of two independent cir- 
cles and is a one-dimensional compact, but not connected, manifold. The boundary 
S"—! = 9B” of the n-dimensional disk of Example 3 is a compact manifold, which 
is connected for n > 1 and disconnected (it consists of two points) ifn = 1. 


Example 5 The space R” itself is obviously a connected noncompact manifold 
without boundary, and the half-space H” provides the simplest example of a con- 
nected noncompact manifold with boundary. (In both cases the atlas can be taken to 
consist of the single chart corresponding to the identity mapping.) 


Proposition 2 [fa manifold M is connected, it is path connected. 
Proof After fixing a point xo € M, consider the set Ey, of points of M that can be 


joined to xo by a path in M. The set Ey,, as one can easily verify from the definition 
of a manifold, is both open and closed in M. But that means that E,, = M. 


Example 6 If to each real n x n matrix we assign the point of IR” whose coordi- 
nates are obtained by writing out the elements of the matrix in some fixed order, 
then the group GL(n, R) of nonsingular n x n matrices becomes a manifold of di- 
mension n*. This manifold is noncompact (the elements of the matrices are not 
bounded) and nonconnected. This last fact follows from the fact that GL(n, IR) con- 
tains matrices with both positive and negative determinants. The points of GL(n, R) 
corresponding to two such matrices cannot be joined by a path. (On such a path 
there would have to be a point corresponding to a matrix whose determinant is 
Zero.) 


Example 7 The group SO(2, R) of orthogonal mappings of the plane R7 having de- 


terminant equal to 1 consists of matrices of the form ( °°" S?® ) and hence can be 


regarded as a manifold that is identified with the circle — the domain of variation of 
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the angular parameter w. Thus SO(2, R) is a one-dimensional compact connected 
manifold. If we also allow reflections about lines in the plane R*, we obtain the 
group O(2, R) of all real orthogonal 2 x 2 matrices. It can be naturally identified 
with two different circles, corresponding to matrices with determinants +1 and —1 
respectively. That is, O(2, R) is a one-dimensional compact, but not connected man- 
ifold. 


Example 8 Let a be a vector in R and T, the group of rigid motions of the plane 
generated by a. The elements of T, are translations by vectors of the form na, where 
n € Z. Under the action of the elements g of the group 7, each point x of the plane 
is displaced to a point g(x) of the form x + na. The set of all points to which a given 
point x € R? passes under the action of the elements of this group of transformations 
is called its orbit. The property of points of R* of belonging to the same orbit is 
obviously an equivalence relation on R?, and the orbits are the equivalence classes 
of this relation. A domain in R* containing one point from each equivalence class 
is called a fundamental domain of this group of automorphisms (for a more precise 
statement see Problem 5d)). 

In the present case we can take as a fundamental domain a strip of width |a| 
bounded by two parallel lines orthogonal to a. We need only take into account that 
these lines themselves are obtained from each other through translations by a and 
—a respectively. Inside a strip of width less than |a| and orthogonal to a there are no 
equivalent points, so that all orbits having representatives in that strip are endowed 
uniquely with the coordinates of their representatives. Thus the quotient set R?/T, 
consisting of orbits of the group Tg becomes a manifold. From what was said above 
about a fundamental domain, one can easily see that this manifold is homeomorphic 
to the cylinder obtained by gluing the boundary lines of a strip of width |a| together 
at equivalent points. 


Example 9 Now let a and b be a pair of orthogonal vectors of the plane R? and 
Ta,p the group of translations generated by these vectors. In this case a fundamental 
domain is the rectangle with sides a and b. Inside this rectangle the only equivalent 
points are those that lie on opposite sides. After gluing the sides of this fundamental 
rectangle together, we verify that the resulting manifold R?/ Ta,b 1s homeomorphic 
to the two-dimensional torus. 


Example 10 Now consider the group G,,, of rigid motions of the plane R? gener- 
ated by the transformations a(x, y) = (x + 1,1— y) and b(x, y)=(x,y+ 1). 

A fundamental domain for the group Ga.» is the unit square whose horizon- 
tal sides are identified at points lying on the same vertical line, but whose vertical 
sides are identified at points symmetric about the center. Thus the resulting manifold 
R*/Ga,p turns out to be homeomorphic to the Klein bottle (see Sect. 12.1). 

We shall not take time to discuss here the useful and important examples studied 
in Sect. 12.1. 
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15.2.2. Smooth Manifolds and Smooth Mappings 


Definition 7 An atlas of a manifold is smooth (of class C™ or analytic) if all the 
coordinate-changing functions for the atlas are smooth mappings (diffeomorphisms) 
of the corresponding smoothness class. 


Two atlases of a given smoothness (the same smoothness for both) are equivalent 
if their union is an atlas of this smoothness. 


Example I1 An atlas consisting of a single chart can be regarded as having any 
desired smoothness. Consider in this connection the atlas on the line R! generated 
by the identity mapping R! 5 x + g(x) =x € R!, and a second atlas — generated 
by any strictly monotonic function R! 5 x + G(x) € R!, mapping R! onto R!. 
The union of these atlases is an atlas having smoothness equal to the smaller of the 
smoothnesses of G and @~!. 

In particular, if G(x) = x3, then the atlas consisting of the two charts {x, x3 } is 
not smooth, since @ !(x) = x!/3, Using what has just been said, we can construct 
seme smooth atlases in R! whose union is an atlas of a preassigned smoothness 
class C™, 


Definition 8 A smooth manifold (of class C“ or analytic) is a manifold M with an 
equivalence class of atlases of the given smoothness. 

After this definition the following terminology is comprehensible: topological 
manifold (of class C®), C -manifold, analytic manifold. 

To give the entire equivalence class of atlases of a given smoothness on a mani- 
fold M it suffices to give any atlas A of this equivalence class. Thus we can assume 
that a smooth manifold is a pair (M, A), where M is a manifold and A an atlas of 
the given smoothness on M. 

The set of equivalent atlases of a given smoothness on a manifold is often called 
a structure of this smoothness on the manifold. There may be different smooth struc- 
tures of even the same smoothness on a given topological manifold (see Example 11 
and Problem 3). 

Let us consider some more examples in which our main attention is directed to 
the smoothness of the coordinate changes. 


Example 12 The one-dimensional manifold RP! called the real projective line, is 
the pencil of lines in R? passing through the origin, with the natural notion of dis- 
tance between two lines (measured, for example, by the magnitude of the smaller 
angle between them). Each line of the pencil is uniquely determined by a nonzero 
direction vector (x!, x*), and two such vectors give the same line if and only if 
they are collinear. Hence RP! can be regarded as a set of equivalence classes of 
ordered pairs (x!, x) of real numbers. Here at least one of the numbers in the pair 
must be nonzero, and two pairs are considered equivalent (identified) if they are pro- 
portional. The pairs (x!, x”) are usually called homogeneous coordinates on RP". 
Using the interpretation of RP! in homogeneous coordinates, it is easy to construct 
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an atlas of two charts on RP!. Let U;, i = 1, 2, be the lines (classes of pairs (x 1 x?)) 
in RP! = which x! 4 0. To each sea (line) p € U; there corresponds a unique 


pair (Ls “) determined by the number i= — . Similarly the points of the region U2 


1 . 
are in one-to-one eevee ie with pairs of the form Ca, 1) and are determined 


x! 
x2 


by the number ,= = +5. Thus local coordinates arise in U; and U2, which obviously 


correspond to the topology introduced above on RP!. In the common range Uj 1U2 
of these local charts the coordinates they introduce are connected by the relations 
= = (t? )~! and i= — @y ! which shows that the atlas is not only C (°°) but even 
analytic. 

It is useful to keep in mind the following interpretation of the manifold RP!. 
Each line of the original pencil of lines is completely determined by its intersec- 
tion with the unit circle. But there are exactly two such points, diametrically op- 
posite to each other. Lines are near if and only if the corresponding points of the 
circle are near. Hence RP! can be interpreted as a circle with diametrically opposite 
points identified (glued together). If we take only a semicircle, there is only one 
pair of identified points on it, the end-points. Gluing them together, we again ob- 
tain a topological circle. Thus RP! is homeomorphic to the circle as a topological 
space. 


Example 13 If we now consider the pencil of lines passing through the origin in R?, 
or, what is the same, the set of equivalence classes of ordered triples of points 
(x!,x?, x3) of real numbers that are not all three zero, we ean v real ye 
jective plane RP*. In the regions U;, U2, and U3 where x! ca 0, x7 40,234 


0 aaa ee we introduce local coordinate systems (1, = a = = (1, it e) ~ 
(2,13), (41,4) = 1,8) ~ 3), and Gas = 0 1) Gis) 
which are obviously connected by the relations i? — = (tj er t) = = Ce me which 
apply in the common portions of the anes of ie chants: 


For example, the transition from (at ity a) to (c. #3) i in the domain U; M U2 is given 
by the formulas 


H=(f) Bae (G) 
x2 


The Jacobian of this transformation is -(R), and since a = o> it is defined 
and nonzero at points of the set Uj M U2 under consideration. 

Thus RP? is a two-dimensional manifold having an analytic atlas consisting of 
three charts. 

By the same considerations as in Example 12, where we studied the projective 
line RP!, we can interpret the projective plane RP as the two-dimensional sphere 
S? C R? with antipodal points identified, or as a hemisphere, with diametrically 
opposite points of its boundary circle identified. Projecting the hemisphere into the 
plane, we obtain the possibility of interpreting RP” as a (two-dimensional) disk with 
diametrically opposite points of its boundary circle identified. 
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Example 14 The set of lines in the plane R? can be partitioned into two sets: U, 
the nonvertical lines, and V, the nonhorizontal lines. Each line in U has an equation 
of the form y = u1x + uz, and hence is characterized by the coordinates (uw, v2), 
while each line in V has an equation x = v; y + v2 and is determined by coordinates 
(v1, U2). For lines in the intersection UM V have the coordinate transformation v; = 
ys v2 = —u2u;! and u, = v5 u2 = —v2v;". Thus this set is endowed with an 
analytic atlas consisting of two charts. 

Every line in the plane has an equation ax + by + c = 0 and is characterized 
by a triple of numbers (a, b, c), proportional triples defining the same line. For that 
reason, it might appear that we are again dealing with the projective plane RP? 
considered in Example 13. However, whereas in RP? we admitted any triples of 
numbers not all zero, now we do not admit triples of the form (0, 0, c) where c 4 0. 
A single point in RP? corresponds to the set of all such triples. Hence the manifold 
obtained in our present example is homeomorphic to the one obtained from RP? by 
removing one point. If we interpret RP? as a disk with diametrically opposite points 
of the boundary circle identified, then, deleting the center of the circle, we obtain, up 
to homeomorphism, an annulus whose outer circle is glued together at diametrically 
opposite points. By a simple incision one can easily show that the result is none 
other than the familiar Mobius band. 


Definition 9 Let M and N be C“-manifolds. A mapping f : M > N is /-smooth 
(a C-mapping) if the local coordinates of the point f(x) € N are C-functions 
of the local coordinates of x « M. 


This definition has an unambiguous meaning (one that is independent of the 
choice of local coordinates) if / < k. 

In particular, the smooth mappings of M into R! are smooth functions on M, and 
the smooth mappings of R! (or an interval of R!) into M are smooth paths on M. 

Thus the degree of smoothness of a function f : M— N onamanifold M cannot 
exceed the degree of smoothness of the manifold itself. 


15.2.3 Orientation of a Manifold and Its Boundary 


Definition 10 Two charts of a smooth manifold are consistent if the transition from 
the local coordinates in one to the other in their common range is a diffeomorphism 
whose Jacobian is everywhere positive. 


In particular, if the ranges of two local charts have empty intersection, they are 
considered consistent. 


Definition 11 An atlas A of a smooth manifold (M, A) is an orienting atlas of M 
if it consists of pairwise consistent charts. 
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Definition 12 A manifold is orientable if it has an orienting atlas. Otherwise it is 
nonorientable. 


Two orienting atlases of a manifold will be regarded as equivalent (in the sense 
of the question of orientation of the manifold considered just now) if their union is 
also an orienting atlas of the manifold. It is easy to see that this relation really is an 
equivalence relation. 


Definition 13 An equivalence class of orienting atlases of a manifold in the relation 
just defined is called an orientation class of atlases of the manifold or an orientation 
of the manifold. 


Definition 14 An oriented manifold is a manifold with this class of orientations of 
its atlases, that is, with a fixed orientation on the manifold. 


Thus orienting the manifold means exhibiting (by some means or other) a certain 
orientation class of atlases on it. To do this, for example, it suffices to exhibit any 
specific orienting atlas from the orientation class. 

Various methods used in practice to define an orientation of manifolds embedded 
in R” are described in Sects. 12.2 and 12.3. 


Proposition 3 A connected manifold is either nonorientable or admits exactly two 
orientations. 


Proof Let A and A be two orienting atlases of the manifold M with diffeomorphic 
transitions from the local coordinates of charts of one to charts of the other. Assume 
that there is a point po € M and two charts of these atlases whose ranges U;, and 
U, ig Contain po; and suppose the Jacobian of the change of coordinates of the charts 
at points of the parameter space corresponding to the point po is positive. We shall 
show that then for every point p € M and any charts of the atlases A and A whose 
ranges contain p the Jacobian of the coordinate transformation at corresponding 
coordinate points is also positive. 

We begin by making the obvious observation that if the Jacobian of the transfor- 
mation is positive (resp. negative) at the point p for any pair of charts containing 
p in the atlases A and A, then it is positive (resp. negative) at p for any such pair 
of charts, since inside each given atlas the coordinate transformations occur with 
positive Jacobian, and the Jacobian of a composition of two mappings is the product 
of the Jacobians of the individual mappings. 

Now let E be the subset of M consisting of the points p € M at which the coor- 
dinate transformations from the charts of one atlas to those of the other have positive 
Jacobian. 

The set E is nonempty, since po € E. The set E is open in M. Indeed, for every 
point p € E there exist ranges U; and Uj j of certain charts of the atlases A and A 
containing p. The sets U; and U; j are open in M, so that the set Uj N Uj j is open 
in M. On the connected component of the set U; 9 U; containing p, which is open 


330 15 *Integration of Differential Forms on Manifolds 


in Uj; U; and in M, the Jacobian of the transformation cannot change sign without 
vanishing at some point. That is, in some neighborhood of p the Jacobian remains 
positive, which proves that E is open. But E is also closed in M. This follows from 
the continuity of the Jacobian of a diffeomorphism and the fact that the Jacobian of 
a diffeomorphism never vanishes. 

Thus E is anonempty open-closed subset of the connected set M. Hence E = M, 
and the atlases A and A define the same orientation on M. 

Replacing one coordinate, say t! by —t! in every chart of the atlas A, we obtain 
the orienting atlas — A belonging to a different orientation class. Since the Jacobians 
of the coordinate transformations from an arbitrary chart to the charts of A and —A 
have opposite signs, every atlas that orients M is equivalent either to A or to —A. 


Definition 15 A finite sequence of charts of a given atlas will be called a chain of 
charts if the ranges of any pair of charts having adjacent indices have a nonempty 
intersection (U; N Uj41 4 @). 


Definition 16 A chain of charts is contradictory or disorienting if the Jacobian of 
the coordinate transformation from each chart in the chain to the next is positive 
and the ranges of the first and last charts of the chain intersect, but the coordinate 
transformation from the last to the first has negative Jacobian. 


Proposition 4 A manifold is orientable if and only if there does not exist a contra- 
dictory chain of charts on it. 


Proof Since every manifold decomposes into connected components whose orienta- 
tions can be defined independently, it suffices to prove Proposition 4 for a connected 
manifold M. 


Necessity. Suppose the connected manifold M is orientable and A is an atlas defin- 
ing an orientation. From what has been said and Proposition 3, every smooth local 
chart of the manifold M connected with the charts of the atlas A is either consistent 
with all the charts of A or consistent with all the charts of —A. This can easily be 
seen from Proposition 3 itself, if we restrict charts of A to the range of the chart we 
have taken, which can be regarded as a connected manifold oriented by one chart. It 
follows from this that there is no contradictory chain of charts on M. 


Sufficiency. It follows from Definition | that there exists an atlas on the manifold 
consisting of a finite or countable number of charts. We take such an atlas A and 
number its charts. Consider the chart (U;,@1) and any chart (Uj, g) such that 
U; 1 U; # ©. Then the Jacobians of the coordinate transformations g1; and 9; 
are either everywhere negative or everywhere positive in their domains of defini- 
tion. The Jacobians cannot have values of different signs, since otherwise one could 
exhibit connected subsets U_ and U, in U; UU; where the Jacobian is negative and 
positive respectively, and the chain of charts (U;, g1), (U+, 91), (Ui, 9), (U_, G) 
would be contradictory. 
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Thus, changing the sign of one coordinate if necessary in the chart (U;, g;), we 
could obtain a chart with the same range Uj and consistent with (U1, g,). After that 
procedure, two charts (U;, gj) and (U;, g;) such that U; NU; 4 9, U; NU; FS, 
U; 1 U; # @ are themselves consistent: otherwise we would have constructed a 
contradictory chain of three charts. 

Thus, all the charts of an atlas whose ranges intersect U; can now be considered 
consistent with one another. Taking each of those charts now as the standard, one 
can adjust the charts of the atlas not covered in the first stage so that they are con- 
sistent. No contradictions arise when we do this, since by hypothesis, there are no 
contradictory chains on the manifold. Continuing this process and taking account of 
the connectedness of the manifold, we construct on it an atlas consisting of pairwise 
consistent charts, which proves the orientability of the manifold. 


This criterion for orientability of the manifold, like the considerations used in its 
proof, can be applied to the study of specific manifolds. Thus, the manifold RP! 
studied in Example 12 is orientable. From the atlas shown there it is easy to obtain 
an orienting atlas of RP!. To do this, it suffices to reverse the sign of the local 
coordinates of one of the two charts constructed there. However, the orientability of 
the projective line RP! obviously also follows from the fact that the manifold RP! 
is homeomorphic to a circle. 

The projective plane RP” is nonorientable: every pair of charts in the atlas con- 
structed in Example 13 is such that the coordinate transformations have domains 
of positivity and domains of negativity of the Jacobian. As we saw in the proof of 
Proposition 4, it follows from this that a contradictory chain of charts on RP? exists. 

For the same reason the manifold considered in Example 14 is nonorientable, 
which, as was noted, is homeomorphic to a Mébius band. 


Proposition 5 The boundary of an orientable smooth n-dimensional manifold is an 
orientable (n — 1)-dimensional manifold admitting a structure of the same smooth- 
ness as the original manifold. 


Proof The proof of Proposition 5 is a verbatim repetition of the proof of the analo- 
gous Proposition 2 of Sect. 12.3.2 for surfaces embedded in R”. 


Definition 17 If A(M) = {(H", g;, U;)} U {(R", g;, U;j)} is an atlas that orients 
the manifold M, then the charts A(dM) = {(R"—!", g; la yn—pn-1, 0U;)} provide an 
orienting atlas for the boundary 0M of M. The orientation of the boundary defined 
by this atlas is called the orientation of the boundary induced by the orientation of 
the manifold. 


Important techniques for defining the orientation of a surface embedded in R” 
and the induced orientation of its boundary, which are frequently used in practice, 
were described in detail in Sects. 12.2 and 12.3. 
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15.2.4 Partitions of Unity and the Realization of Manifolds 
as Surfaces in IR" 


In this subsection we shall describe a special construction called a partition of unity. 
This construction is often the basic device for reducing global problems to local 
ones. Later on we shall demonstrate it in deriving Stokes’ formula on a manifold, 
but here we shall use the partition of unity to clarify the possibility of realizing any 
manifold as a surface in R” of sufficiently high dimension. 


Lemma One can construct a function f € C‘©)(R,R) on R such that f (x) = 
for |x| =3, f(x) = 1 for |x| < 1, and 0 < f(x) < 1 for 1 < |x| <3. 


POT We shall construct one such function using the familiar function g(x) = 


te tye) ves’ Previously (see Exercise 2 of Sect. 5.2) we verified that g € 
or x= 


co) (R, R) by showing that g (0) = 0 for every value n € N. 
In such a case the nonnegative function 


G(x) eH OD? OD for fx} <1, 
od 
for |x| > 1 


also belongs to C‘)(R, R), and along with it the function 


x +00 
rays f Gonar/ | G(t)dt+ 


belongs to this class, since F’(x) = G(x)/ es G(t) dt. 

The function F is strictly increasing on [—1, 1], F(x) =0 for x < —1, and 
F(x)=1forx>1. 

We can now take the required function to be 


f(x) = F(x +2)+ F(-x —2)-1. 


Remark If f : IR > R is the function constructed in the proof of the lemma, then 
the function 


O(x!,...,x") = f(x! —a')-...- f(x" —a") 


defined in R” is such that 6 € C‘()(R", R), 0< 6 < 1, at every point x € R”, 
(x) = 1 on the interval I(a) = {x € R” | |x’ — a'| < 1,i=1,...,n}, and the 
Support supp@ of the function @ is contained in the interval ia {x € R? | 
Ix’ —a'| <3,i=1,...,n}. 


Definition 18 Let M be a C“)-manifold and X a subset of M. The system E = 
{ey, a € A} of functions eg € C“ (M, R) is a C partition of unity on X if 
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1° 0 <e,(x) <1 for every function ég € EF and every x € M; 

2° each point x € X has a neighborhood U(x) in M such that all but a finite 
number of functions of E are identically zero on U(x); 

3° ewck Ca(x) = lon X. 

We remark that by condition 2° only a finite number of terms in this last sum are 
nonzero at each point x € X. 


Definition 19 Let O = {og, B € B} be an open covering of X C M. We say that 
the partition of unity E = {ey,a € A} on X is subordinate to the covering O if the 
support of each function in the system E is contained in at least one of the sets of 
the system O. 


Proposition 6 Let {(U;,9;),i = 1,...,m} be a finite set of charts of some ch& 
atlas of the manifold M, whose ranges Uj, i = 1, ...,m, form a covering of a com- 
pact set K C M. Then there exists a C® partition of unity on K subordinate to the 
covering {U;,i=1,...,m}. 


Proof For any point xo € K we first carry out the following construction. We choose 
successively a domain U; containing x9 corresponding to a chart g; : R” > U; (or 
gy; : H" — U;), the point fo = yg, (x9) € R” (or A”), the function 6(t — to) (where 
@(t) is the function shown in the remark to the lemma), and the restriction 6, of 
0(t — to) to the parameter domain of g;. 

Let J;, be the intersection of the unit cube centered at to € R” with the pa- 
rameter domain of g;. Actually 6,, differs from @(t — fo) and J,, differs from the 
corresponding unit cube only when the parameter domain of the chart g; is the 
half-space H”. The open sets yj; (J;) constructed at each point x € K and the point 
t=Q, : (x), taken for all admissible values of i = 1, 2,...,m, form an open cov- 
ering of the compact set K. Let {g;, (Ui), 7 = 1,2,...,/} be a finite covering of K 
extracted from it. It is obvious that 9g; j CF 7) CU; i We define on U; j the function 


6; (x)= 1, fc) Pr; ! (x). We then extend 6, j(x) to the entire manifold M by setting the 
function equal to zero outside U;,. We retain the previous notation @; for this func- 
tion extended to M. By construction 6; ech (M,R), supp 6; Cc Ui, ,0O< 6; (x) <1 
on M, and 0;(x) =1 on $i; (i;) Cc Uj). Then the functions e;(x) = 0; (x), e2(x) = 
62(x)(1—61(x)), ..., er(x) = (x) A — @-1(x))-...- 1 — 61 («)) form the required 
partition of unity. We shall verify only that yet ej(x) =1 0n K, since the system 


of functions {e),..., e7} obviously satisfies the other conditions required of a parti- 
tion of unity on K subordinate to the covering {Uj,,..., Ui} C{Uj,i=1,...,m}. 
But 


l 


1—) ej) =(1-61(%))-...- (1-41 @)) =0 on K, 


j=l 


since each point x € K is covered by some set g;,(/;,) on which the corresponding 


function 6; is identically equal to 1. 
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Corollary 1 /f M is a compact manifold and A a C™ atlas on M, then there exists 
a finite partition of unity {e1, ..., e1} on M subordinate to a covering of the manifold 
by the ranges of the charts of A. 


Proof Since M is compact, the atlas A can be regarded as finite. We now have the 
hypotheses of Proposition 6, if we set K = M in it. 


Corollary 2 For every compact set K contained in a manifold M and every open 
set GC M containing K, there exists a function f : M — R with smoothness equal 
to that of the manifold and such that f(x) =1 on K and supp f CG. 


Proof Cover each point x € K by a neighborhood U(x) contained in G and inside 
the range of some chart of the manifold M. From the open covering {U(x), x € K} 
of the compact set K extract a finite covering, and construct a partition of unity 
{e,,...,e;} on K subordinate to it. The function f = ae 1 éi 18 the one required. 


Corollary 3 Every (abstractly defined) compact smooth n-dimensional manifold M 
is diffeomorphic to some compact smooth surface contained in R™ of sufficiently 
large dimension N. 


Proof So as not to complicate the idea of the proof with inessential details,we carry 
it out for the case of a compact manifold M without boundary. In that case there is 
a finite smooth atlas A = {g; : 1 > U;,i=1,...,m} on M, where I is an open n- 
dimensional cube in R”. We take a slightly smaller cube J’ such that I’ Cc I and the 
set {U/ = 9;(1'),i=1,...,m)} still forms a covering of M. Setting K = /',G=1, 
and M = R” in Corollary 2, we construct a function f € C (Co) QR” IR) such that 
f@ =1 fort €J7' and supp f CI. 

We now consider the coordinate functions a (x), ...,#"(x) of the mappings g, 1, 
U; > I,i=1,...,m, and use them to introduce the following function on M: 


(fog, ')(x)- tk) forx € Uj, 


k 
“(x)= 
OO) 0 for x ¢ Uj, 


At every point x € M the rank of the mapping M 3 x y(x) = (yt, ep Vreees 
yh w+ Yn (x) € R”” is maximal and equal to n. Indeed, if x € U;, then yg, | (x)= 
tel’, fog, '(x)=1, and y¥(@;@)) =H, k=1,...,n. 

If finally, we consider the mapping M 3 x + Y(x) = (y(x), fo 9, | (x), saat © 
7, ! (x)) €R”""*", setting f o gy, | (x) = 0 outside U;, i = 1, ..., m, then this map- 
ping, on the one hand will obviously have the same rank n as the mapping x b> y(x); 
on the other hand it will be demonstrably a one-to-one mapping of M onto the im- 
age of M in R””*"”, Let us verify this last assertion. Let p,q be different points 
of M. We find a domain U/ from the system {Uj,i = 1,...,m} covering M that 
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contains the point p. Then f og, '(p) =1. If fog; '(q) <1, then Y(p) # Y(q). 


If fog, '(q) = 1, then p,q € U;, y¥(p) =t*(p), yk(q) = t*(q), and tk (p) £ tk) 
for at least one value of k € {1,...,}. That is, Y(p) 4 Y(q) in this case. 


For information on the general Whitney embedding theorem for an arbitrary 
manifold as a surface in R” the reader may consult the specialized geometric lit- 
erature. 


15.2.5 Problems and Exercises 


1. Verify that the object (a manifold) introduced by Definition | does not change if 
we require only that each point x € M have a neighborhood U(x) C M homeomor- 
phic to an open subset of the half-space H”. 

2. Show that 


a) the manifold GL(n, R) of Example 6 is noncompact and has exactly two con- 
nected components; 

b) the manifold SO(n, R) (see Example 7) is connected; 

c) the manifold O(n, R) is compact and has exactly two connected components. 


3. Let (M, A) and (M, A) be manifolds with smooth structures of the same degree 
of smoothness C“ on them. The smooth manifolds (M, A) and (M, A) (smooth 
structures) are considered isomorphic if there exists a_C ® mapping f : M > M 
having a C inverse f~!: M — M in the atlases A, A. 


a) Show that all structures of the same smoothness on R! are isomorphic. 

b) Verify the assertions made in Example 11, and determine whether they con- 
tradict a). 

c) Show that on the circle S! (the one-dimensional sphere) any two C (°°) struc- 
tures are isomorphic. We note that this assertion remains valid for spheres of dimen- 
sion not larger than 6, but on S7, as Milnor* has shown, there exist nonisomorphic 
C©) structures. 


4. Let S be a subset of an n-dimensional manifold M such that for every point 
xo € S there exists a chart x = g(t) of the manifold M whose range U contains xo, 
and the k-dimensional surface defined by the relations t+! =0,..., 1" =0 corre- 
sponds to the set SU in the parameter domain t = (t!,..., t”) of g. In this case 
S is called a k-dimensional submanifold of M. 


a) Show that a k-dimensional manifold structure naturally arises on S, induced 
by the structure of VM and having the same smoothness as the manifold M. 

b) Verify that the k-dimensional surfaces S in R” are precisely the k-dimensional 
submanifolds of R”. 


4], Milnor (b. 1931) — one of the most outstanding modern American mathematicians; his main 
works are in algebraic topology and the topology of manifolds. 
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c) Show that under a smooth homeomorphic mapping f : R! — T? of the line 
R! into the torus T? the image f(R!) may be an everywhere dense subset of T? 
and in that case will not be a one-dimensional submanifold of the torus, although it 
will be an abstract one-dimensional manifold. 

d) Verify that the extent of the concept “submanifold” does not change if we 
consider S C M a k-dimensional submanifold of the n-dimensional manifold M@ 
when there exists a local chart of the manifold M whose range contains xo for every 
point x9 € S and some k-dimensional surface of the space R” corresponds to the set 
SU in the parameter domain of the chart. 


5. Let X be a Hausdorff topological space (manifold) and G the group of homeo- 
morphic transformations of X. The group G is a discrete group of transformations 
of X if for every two (possibly equal) points x1, x2 € X there exist neighborhoods 
U, and U> of them respectively, such that the set {g € G | g(U1) NU2 F OD} is finite. 


a) It follows from this that the orbit {g(x) € X | g € G} of every point x € X is 
discrete, and the stabilizer Gy = {g € G| g(x) = x} of every point x € X is finite. 

b) Verify that if G is a group of isometries of a metric space, having the two 
properties in a), then G is a discrete group of transformations of X. 

c) Introduce the natural topological space (manifold) structure on the set X/G 
of orbits of the discrete group G. 

d) Aclosed subset F of the topological space (manifold) X with a discrete group 
G of transformations is a fundamental domain of the group G if it is the closure of 
an open subset of X and the sets g(F’), where g € G, have no interior points in 
common and form a locally finite covering of X. Show using Examples 8-10 how 
the quotient space X/G (of orbits) of the group G can be obtained from F by 
“gluing” certain boundary points. 


6. a) Using the construction of Examples 12 and 13, construct n-dimensional pro- 
jective space RP”. 

b) Show that RP” is orientable if n is odd and nonorientable if n is even. 

c) Verify that the manifolds SO(3, R) and RP° are homeomorphic. 


7. Verify that the manifold constructed in Example 14 is indeed homeomorphic to 
the Mobius band. 
8. a) A Lie group” is a group G endowed with the structure of an analytic manifold 
such that the mappings (g1, g2) > g1- g2 and g+> g™! are analytic mappings of 
G x G and G into G. Show that the manifolds in Examples 6 and 7 are Lie groups. 
b) A topological group (or continuous group) is a group G endowed with the 
structure of a topological space such that the group operations of multiplication and 
inversion are continuous as mappings G x G — G, and G —> G in the topology 
of G. Using the example of the group Q of rational numbers show that not every 
topological group is a Lie group. 


5§. Lie (1842-1899) — outstanding Norwegian mathematician, creator of the theory of continuous 
groups (Lie groups), which is now of fundamental importance in geometry, topology, and the math- 
ematical methods of physics; one of the winners of the International Lobachevskii Prize (awarded 
in 1897 for his work in applying group theory to the foundations of geometry). 


15.3 Differential Forms and Integration on Manifolds 337 


c) Show that every Lie group is a topological group in the sense of the definition 
given in b). 

d) It has been proved® that every topological group G that is a manifold is a 
Lie group (that is, as a manifold G admits an analytic structure in which the group 
becomes a Lie group). Show that every group manifold (that is, every Lie group) is 
an orientable manifold. 


9. A system of subsets of a topological space is locally finite if each point of the 
space has a neighborhood intersecting only a finite number of sets in the system. In 
particular, one may speak of a locally finite covering of a space. 

A system of sets is said to be a refinement of a second system if every set of the 
first system is contained in at least one of the sets of the second system. In particular 
it makes sense to speak of one covering of a set being a refinement of another. 


a) Show that every open covering of R” has a locally finite refinement. 

b) Solve problem a) with R” replaced by an arbitrary manifold M. 

c) Show that there exists a partition of unity on R” subordinate to any preas- 
signed open covering of R”. 

d) Verify that assertion c) remains valid for an arbitrary manifold. 


15.3 Differential Forms and Integration on Manifolds 


15.3.1 The Tangent Space to a Manifold at a Point 


We recall that to each smooth path R 5 tre> x(t) € R” (a motion in R”) passing 
through the point x9 = x(fo) € R” at time to we have assigned the instantaneous 
velocity vector € = (€!,...,€") :€(t) = x(t) = (a!,..., *”) (to). The set of all such 
vectors € attached to the point x9 € R” is naturally identified with the arithmetic 
space IR” and is denoted TR? » (or Txo (R”)). In TRY, one introduces the same vector 
operations on elements € € TRY, as on the corresponding elements of the vector 
space R”. In this way a vector space TRY, arises, called the tangent space to R" at 
the point xo € R". 

Forgetting about motivation and introductory considerations, we can now say 
that formally TRY, is a pair (xo, R") consisting of a point xo € R” and a copy of the 
vector space R” attached to it. 

Now let M be a smooth n-dimensional manifold with an atlas A of at least C! 
smoothness. We wish to define a tangent vector and a tangent space TM ,, to the 
manifold M at a point po € M. 

To do this we use the interpretation of the tangent vector as the instantaneous ve- 


locity of a motion. We take a smooth path R” 5 eee p(t) € M on the manifold M@ 
passing through the point po = p(to) € M at time fo. The parameters of charts (that 


©This is the solution to Hilbert’s fifth problem. 
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is, local coordinates) of the manifold M will be denoted by the letter x here, with the 
subscript of the corresponding chart and a superscript giving the number of the co- 
ordinate. Thus, in the parameter domain of each chart (U;, g;) whose range U; con- 


tains po, the path r ts yg, | o p(t) = x;(t) € R” (or H”) corresponds to the path y. 


This path is smooth by definition of the smooth mapping R 5 ¢ ae p(the M. 

Thus, in the parameter domain of the chart (U;, g;), where g; is a mapping p = 
gi(x;), there arises a point x; (fo) = y, (po) and a vector & = x;(to) € TRY, (t)° 
In another such chart (U;, g;) these objects will be respectively the point x; (#9) = 
g;" (po) and the vector §; = x;(to) € TRY, (t9)° It is natural to regard these as the 
coordinate expressions in different charts of what we would like to call a tangent 
vector € to the manifold M at the point po € M. 

Between the coordinates x; and x; there are smooth mutually inverse transition 


mappings 
Xi = Qi (Xj), Xj = Gij i), (15.30) 


as a result of which the pairs (x; (to), &), (x; (to), €;) turn out to be connected by the 
relations 


x; (tg) = 01 (4j Co), x; (to) = gi (xi (fo), (15.31) 
E=Gii(xj(to))E, Ej) = G4; (X10) i- (15.32) 
Equality (15.32) obviously follows from the formulas 
GO=Gi x O)jO,  BO=G;, UO), 
obtained from (15.30) by differentiation. 


Definition 1 We shall say that a tangent vector — to the manifold M at the point 
p € M is defined if a vector &; is fixed in each space TRY, tangent to R” at the point 
x; corresponding to p in the parameter domain of a chart (U;, g;), where Uj > p, in 
such a way that (15.32) holds. 


If the elements of the Jacobian matrix Y; ; of the mapping ¢j; are written out 

axk : — : 

ah , we find the following explicit form for the connection between 
j 


the two coordinate representations of a given vector &: 


explicitly as 


=). mép, k=1,2,...,0, (15.33) 


where the partial derivatives are computed at the point x; = g;' (p) corresponding 
to p. , 

We denote by TM, the set of all tangent vectors to the manifold M at the point 
peM. 
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Definition 2 If we introduce a vector-space structure on the set 7M , by identifying 
TM , with the corresponding space TRY, (or TH’.,), that is, the sum of vectors in 
TM p is regarded as the vector whose coordinate representation in TR, (or TH’. ) 
corresponds to the sum of the coordinate representations of the terms, and multipli- 
cation of a vector by a scalar is defined analogously, the vector space so obtained is 
usually denoted either TM y or T, M, and is called the tangent space to the manifold 
M at the point pe M. 


It can be seen from formulas (15.32) and (15.33) that the vector-space structure 
introduced in TM , is independent of the choice of individual chart, that is, Defini- 
tion 2 is unambiguous in that sense. 

Thus we have now defined the tangent space to a manifold. There are various 
interpretations of a tangent vector and the tangent space (see Problem 1). For exam- 
ple, one such interpretation is to identify a tangent vector with a linear functional. 
This identification is based on the following observation, which we make in R”. 

Each vector § € TR}, is the velocity vector corresponding to some smooth path 
x = x(t), that is, € = x(t)|+=%) with xo = x(to). This makes it possible to define the 
derivative Dg f (xo) of a smooth function f defined on R” (or in a neighborhood of 
x0) with respect to the vector § <¢ TRY, . To be specific, 


d 
De f (0) = FU EMO <9 (15.34) 


that is, 


Dg f (xo) = f' (xo, (15.35) 


where f’(xo) is the tangent mapping to f (the differential of f) at a point xo. 

The functional Dz : C‘ IR", R) > R assigned to the vector & € TRy, by the 
formulas (15.34) and (15.35) is obviously linear with respect to f. It is also clear 
from (15.35) that for a fixed function f the quantity Ds f(x) is a linear function 
of &, that is, the sum of the corresponding linear functionals corresponds to a sum 
of vectors, and multiplication of a functional Dz by a number corresponds to mullti- 
plying the vector € by the same number. Thus there is an isomorphism between the 
vector space TR‘, and the vector space of corresponding linear functionals Dg. It 
remains only to define the linear functional Dg by exhibiting a set of characteristic 
properties of it, in order to obtain a new interpretation of the tangent space TR‘, 
which is of course isomorphic to the previous one. 

We remark that, in addition to the linearity indicated above, the functional D¢ 
possesses the following property: 


De (f + 8)(X0) = De f (x0) - 80) + f 0) - Deg (xo). (15.36) 


This is the law for differentiating a product. 

In differential algebra an additive mapping a+ a’ of a ring A satisfying 
the relation (a - b)’ =a’. b+a-b’ is called derivation (more precisely deriva- 
tion of the ring A). Thus the functional Dz : C () QR”, R) is a derivation of the 


340 15 *Integration of Differential Forms on Manifolds 


ring CR", R). But Dg is also linear relative to the vector-space structure of 
COR", R). 

One can verify that a linear functional / : C‘°) (R”, R) > R possessing the prop- 
erties 


(af + Bg) =al(f)+ Bl(g), a, BER, (15.37) 
Uf -g)=lf)g@o) + fo)l(g), (15.38) 


has the form Dz, where & ¢ TRY. Thus the tangent space TR, to R” at xo can be 


interpreted as a vector space of functionals (derivations) on C‘) (R”, R) satisfying 
conditions (15.37) and (15.38). 

The functions De, f (xo) = we Ff (X)|x=x9 that compute the corresponding partial 
derivative of the function f at xo correspond to the basis vectors e1,..., @, of the 
space TRY. Thus, under the functional interpretation of TRY, one can say that the 


funcaghals {xy Testes sa tls= x) form a basis of TRY, 
Ifé=é!,...,e0E TR" 
has the form pee pe 8 a 


In acompletely analogous manner the tangent vector € to an n-dimensional C ‘©? 
manifold M at a point po € M can be interpreted (or defined) as the element of 
the space of derivations / on Cc‘) (M, R) having properties (15.37) and (15.38), 
xo of course being replaced by po in relation (15.38), so that the functional / is 
connected with precisely the point po € M. Such a definition of the tangent vector 
€ and the tangent space TM ,, does not formally require the invocation of any local 
coordinates, and in that sense it is obviously invariant. In coordinates (x, wk”) 
of a local chart (U;, g;) the operator / has the form él a feee gn 0 at = Ds,. 


ST 


xo? then the operator De corresponding to the vector & 


The numbers (&}, ...,&/") are naturally called the coordinates of the tangent vector 
1 €7TM,, in coordinates of the chart (U;, 9). By the laws of differentiation, the 
coordinate representations of the same functional / ¢ TM, in the charts (U;, gj), 
(U;, gj) are connected by the relations 


n ‘ » n 7 zs 9 
are: 2 p= 28; - - (oz sone, i) 2 (15.33’) 


k=1 \m=1 J 


which of course duplicate (15.33). 


15.3.2 Differential Forms on a Manifold 


Let us now consider the space T*M, conjugate to the tangent space TM p, that is, 
T*M, is the space of real-valued linear functionals on TM p. 


Definition 3 The space T*M, conjugate to the tangent space TM , to the manifold 
M at the point p € M is called the cotangent space to M at p. 
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If the manifold M is a C‘°) manifold, f ¢ C‘©)(M, R), and I, is the derivation 
corresponding to the vector £ € TMp, then for a fixed f € C‘©)(M, R) the mapping 
& +> I; f will obviously be an element of the space T* Mp. In the case M = R” we 
obtain € + Dz f(p) = f'(p)é, so that the resulting mapping € +> /; f is naturally 
called the differential of the function f at p, and is denoted by the usual symbol 


df(p). 
If TR’ 1 ) (or TH! ’ when p € 0M) is the space corresponding to the 
Pu \P Pa 


tangent space TM, in the chart (Ug, @q) on the manifold M, it is natural to re- 


gard the space T*R”_ i conjugate to TR!_ ,,.. as the representative of the space 
Yu \P 


Ga (P) 
T*M, in this local chart. In coordinates Cy eee a of a local chart (Ug, Ga) 
the dual basis {dx!,...,dx”} in the conjugate space corresponds to the basis 


Cae a uaz} of TREN) (or TH" _,. if p € 9M). We recall that dx! (€) =&', so 
that dx' (4) — by. The expressions for these dual bases in another chart (Ug, gg) 


. a axl, a i axl, J 
may turn out to be not so simple, for “> = —& <—, dxy = —§ dxz. 
Ix, ax, Oxy ax, 


Definition 4 We say that a differential form w™” of degree m is defined on an n- 
dimensional manifold M if a skew-symmetric form w”(p) : (TM,)’” — R is de- 
fined on each tangent space TM, to M, pe M. 


In practice this means only that a corresponding m-form wy (xq), where xy = 


¢,, |(p), is defined on each space TR’ -1( (or TH" 1 i: corresponding to TMo 
ga (Pp P 


in the chart (Ug, Gq) of the manifold M. . The fact that two such forms Wy (Xo) and 
wg (xg) are representatives of the same form w(p) can be expressed by the relation 


Wa (Xa) (Era, ---s Ema) = op (xp) ((E1)p, --- Em) B), (15.39) 
in which xq and xg are the representatives of the point p € M, and (€))a,.-.., (Em)a 
and (&1)g,..-, (m)g are the coordinate representations of the vectors &},...,&m € 


TM » in the charts (Ug, ga), (Ug, gg) respectively. 
In more formal notation this means that 


Xa = Ppa(xg), XB = Pop (Xa), (15.31’) 
ba = Ppalxpép, EB = Vip (Xa)éa. (15.32) 


where, as usual, Ygq and yp are respectively the functions gy ze) yg and 5 © Day 
for the coordinate transitions, and the tangent mappings to them Pou =! (Pga)x> 
Pup =! (Gap)» Provide an isomorphism of the tangent spaces to IR” (or H”) at the 
corresponding points x,» and xg. As stated in Sect. 15.1.3, the adjoint mappings 
(Poq)* =) Pou and (Gig)* =: Pap provide the transfer of the forms, and the relation 
(15.39) means precisely that 


a (Xa) = Gap (Xa)@B (XB), (15.39’) 


where a and £ are indices (which can be interchanged). 
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The matrix (c} ) of the mapping Pup (Xq@) is known: ie )= (5 #) (xa). Thus, if 


@al%a)= Sy digi AXE A+ A dx (15.40) 


1<i| <:+-<im<n 
and 


opp= D> Bjnin Exp An A dxf, (15.41) 


L<j)<-+<jm<n 


then according to Example 7 of Sect. 15.1 we find that 


: ; iy Pacer im — 
) Git im AXqy Ao A dx" = 


1Sij <-++ <i <n 


= a Din... 


1<i) <-+-<im<n 
ISji<--<jmsn 


a(xz', bs ine) 


i i 
O(Xol, 2. 5 Xa” 


(Xq) dxil A ++. A dxim, (15.42) 


where at as always, denotes the determinant of the matrix of corresponding partial 


derivatives. 

Thus different coordinate expressions for the same form @ can be obtained from 
each other by direct substitution of the variables (expanding the corresponding dif- 
ferentials of the coordinates followed by algebraic transformations in accordance 
with the laws of exterior products). 

If we agree to regard the form wz, as the transfer of a form w defined on a mani- 
fold to the parameter domain of the chart (Uy, gy), it is natural to write wy = gia 
and consider that wy = yo (95 ')*op = BOB» where the composition @; o (g3')* 


in this case plays the role of a formal elaboration of the mapping ¢* = (G5 Gy)”. 


Definition 5 A differential m-form w on an n-dimensional manifold M is a C” 
form if the coefficients aj, ._i,,(Xa) of its coordinate representation 


— a*,) — & 4 it i 
Wy = Gy 0 = ) Git ..im (Xa) Axy A+ Adxgn 


1S<i <++<im <n 


are C™ functions in every chart (Uy, Gy) of an atlas that defines a smooth structure 
on M. 


It is clear from (15.42) that Definition 5 is unambiguous if the manifold M itself 
isa C+) manifold, for example if M is a C‘©) manifold. 

For differential forms defined on a manifold the operations of addition, multipli- 
cation by a scalar, and exterior multiplication are naturally defined pointwise. (In 
particular, multiplication by a function f : M — R, which by definition is regarded 
as a form of degree zero, is defined.) The first two of these operations turn the set 
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2" of m-forms of class C™ on M into a vector space. In the case k = 00 this 
vector space is usually denoted $2”. It is clear that exterior multiplication of forms 
ow”! € 2" and wo”? € 27” yields a form wo! 4"? = 0"! Aw”? € QT", 


15.3.3 The Exterior Derivative 


Definition 6 The exterior differential is the linear operator d : Q7" > on pos- 


sessing the following properties: 

1° On every function f € OQ the differential d : teh > ce cam equals the usual 
differential df of this function. 

29d: (0! Aw”) = dw" Aa! + (-1)™ a"! A do”, where w”! € 27"! and 
wo EQ”. 

3° d? :=dod=0. 


This last equality means that d(d@) is zero for every form w. 

Requirement 3° thus presumes that we are talking about forms whose smooth- 
ness is at least C®. 

In practice this means that we are considering a C‘°) manifold M and the oper- 
ator d mapping 2” to Q”t!. 

A formula for computing the operator d in local coordinates of a specific chart 
(and at the same time the uniqueness of the operator d) follows from the relation 


a( 2 re CALs rvenaxin) = 


1<ij <-++<im <n 


= DS dei nig 0) A de! Ao A di + 


1<ij <-+-<im <n 


+( y Cin Ua" A+ Adal) =0). (15.43) 


1S<ij <+++<im <n 


The existence of the operator d now follows from the fact that the operator de- 
fined by (15.43) in a local coordinate system satisfies conditions 1°, 2°, and 3° of 
Definition 6. 

It follows in particular from what has been said that if w, = yyw and wg = eo) 
are the coordinate representations of the same form a, that is, wy = Pop©B> then 
dw and dwg will also be the coordinate representations of the same form (da), 
that is, dwy = Pap dwg. Thus the relation d(GigB) = Pop (dwg) holds, which in 
abstract form asserts the commutativity 


dg* = y*d (15.44) 


of the operator d and the operation g* that transfers forms. 
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15.3.4 The Integral of a Form over a Manifold 


Definition 7 Let M be an n-dimensional smooth oriented manifold on which the 
coordinates x!,...,x” and the orientation are defined by a single chart g, : Dy > 
M with parameter domain D, C R”. Then 


fox| a(x) dx! A--»Adx", (15.45) 
M Dy 


where the left-hand side is the usual integral of the form w over the oriented man- 
ifold M and the right-hand side is the integral of the function f(x) over the do- 
main D,. 


If g, : D; > M is another atlas of M consisting of a single chart defining the 
same orientation on M as ¢, : D, — M, then the Jacobian det y’(t) of the function 
x = y(t) of the coordinate change is everywhere positive in D;. The form 


y* (a(x) dx! A--- Adx”) =a(x(0)) detg! (1) dt! A.» A dt" 


in D; corresponds to the form w. By the theorem on change of variables in a multiple 
integral we have the equality 


/ a(sydx! ede" = f a(x(t)) detg!(t) dr’ --- de”, 
ra Dr 


which shows that the left-hand side of (15.45) is independent of the coordinate sys- 
tem chosen in M. 
Thus, Definition 7 is unambiguous. 


Definition 8 The support of a form w defined on a manifold M is the closure of the 
set of points x € M where w(x) £0. 


The support of a form w is denoted by supp. In the case of 0-forms, that is, 
functions, we have already encountered this concept. Outside the support the coor- 
dinate representation of the form in any local coordinate system is the zero form of 
the corresponding degree. 


Definition 9 A form defined on a manifold M is of compact support if supp @ is 
a compact subset of M. 


Definition 10 Let w be a form of degree n and compact support on an n- 
dimensional smooth manifold M oriented by the atlas A. Let g; : Dj — Uj, 
{(U;,g~),i = 1,...,m} be a finite set of charts of the atlas A whose ranges 
Ui,...,Um cover suppa@, and let e1,...,e, be a partition of unity subordinate to 
that covering on supp w. Repeating some charts several times if necessary, we can 
assume that m = k, and that suppe; C Uj, i=1,...,m. 
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The integral of a form w of compact support over the oriented manifold M is the 
quantity 


LerXd, 0} (e:@), (15.46) 


where gF (e;@) is the coordinate representation of the form e;@|y, in the domain D; 
of variation of the coordinates of the corresponding local chart. 


Let us prove that this definition is unambiguous. 


Proof Let A= {Qj : Dj > Uj} be a second atlas defining the same smooth struc- 
ture and orientation on M as the atlas A, let Uj, ..., Uj, be the corresponding cov- 
ering of supp, and let €1,..., @;, a partition of unity on supp subordinate to this 
covering. We introduce the functions fj; = ejé;,i=1,...,m, j=1,...,m, and 
we set wij = fijo. 

We remark that suppa;j C Wij = Ui U j- From this and from the fact that 
Definition 7 of the integral over an oriented manifold given by a single chart is 
unambiguous it follows that 


/ vito) = | vito) = | Fo) = | Q; (Wij). 
Dj g; (Wij) Q; (Wij) © Dj ~ 


Summing these equalities on i from 1 to m and on j from | to m, taking account 
of the relation )7", fij =@j, D0 fij = ei, we find the identities we are interested 
int. 


15.3.5 Stokes’ Formula 


Theorem Let M be an oriented smooth n-dimensional manifold and w a smooth 
differential form of degree n — | and compact support on M. Then 


: o= | da, (15.47) 
aM M 


where the orientation of the boundary 0M of the manifold M is induced by the 
orientation of the manifold M. If 0M = ©, then te dw = 0. 


Proof Without loss of generality we may assume that the domains of variation of 
the coordinates (parameters) of all local charts of the manifold M are either the open 
cube J = {x € R”|0 <x! <1,i=1,...,n}, or the cube 7 ={x eR" |0 <x! < 
1A0 <x! <1,i=1,...,n} with one (definite!) face adjoined to the cube /. 

By the partition of unity the assertion of the theorem reduces to the case when 
supp is contained in the range U of a single chart of the form g: J > U or 
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Q: 1 — U. In the coordinates of this chart the form w has the form 


n oa: 
o=) aj(x) dx! A---Adx! A-+Adx", 


i=1 


where the frown —, as usual, means that the corresponding factor is omitted. 
By the linearity of the integral, it suffices to prove the assertion for one term of 
the sum: 


aj =aj(x) dx! A---Adx! A--- A dx". (15.48) 


The differential of such a form is the n-form 
i-1| aj 1 n 
daw; = (—1) ag A+++ Adx", (15.49) 
x 


For a chart of the form g : J — U both integrals in (15.47) of the correspond- 
ing forms (15.48) and (15.49) are zero: the first because suppa; C J and the sec- 
ond for the same reason, if we take into account Fubini’s theorem and the relation 


ie oa dx! = a; (1) — a;(0) = 0. This argument also covers the case when 0M = ©. 


Thus it remains to verify (15.47) for a chart 9 : 1 > U. 

If i > 1, both integrals are also zero for such a chart, which follows from the 
reasoning given above. 

And if i = 1, then 


0 
/ dws = [ doy = f(a) del dx" = 
M U 7 Ox 
1 1 i.) 
2 f (/ 27) 6) ax! dx2..-dx”? = 
0 0 \Jo dx! 
1 1 
-/ f an(Ix? 2.0") dade" = f w= | Q|. 
0 0 aU aM 


Thus formula (15.47) is proved for n > 1. 

The case n = | is merely the Newton—Leibniz formula (the fundamental theorem 
of calculus), if we assume that the endpoints a and £ of the oriented interval [a, 6] 
are denoted a_ and f+ and the integral of a 0-form g(x) over such an oriented point 
is equal to —g(a) and +g(8) respectively. 


We now make some remarks on this theorem. 


Remark I Nothing is said in the statement of the theorem about the smoothness 
of the manifold M and the form @. In such cases one usually assumes that each 
of them is C‘©). It is clear from the proof of the theorem, however, that formula 
(15.47) is also true for forms of class C® on a manifold M admitting a form of this 
smoothness. 
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Remark 2 Itis also clear from the proof of the theorem, as in fact it was already from 
the formula (15.47), that if supp @ is a compact set contained strictly inside M, that 
is, supp@ 0M = @, then [dw =0. 


Remark 3 If M is a compact manifold, then for every form w on M the support 
supp @, being a closed subset of the compact set M, is compact. Consequently in this 
case every form w on M is of compact support and Eq. (15.47) holds. In particular, 
if M is a compact manifold without boundary, then the equality vu d@ = 0 holds 
for every smooth form on M. 


Remark 4 For arbitrary forms w (not of compact support) on a manifold that is not 
itself compact, formula (15.47) is in general not true. 


. dy—ydx 
Let us consider, for example, the form = **} a 5 


{(x, y) € R* | 1 < x7 + y* < 2}, endowed with standard Cartesian coordinates. In 
this case M is a compact two-dimensional oriented manifold, whose boundary 0M 
consists of the two circles C; = {(x, y) € R2 | x24 ye =i},i=1,2. Since dw =0, 
we find by formula (15.47) that 


o=f dw= | of Q, 
M C2 Ci 


where both circles C; and C2 are traversed counterclockwise. We know that 


[=| o=2 40. 


Hence, if we consider the manifold M=M \C,, then aM = C2 and 


[eo-op2n= | o. 
M aM 


15.3.6 Problems and Exercises 


in a circular annulus M = 


1. a) We call two smooth paths y; : RR M,i = 1,2 on a smooth manifold M@ 
tangent at a point p € M if y, (0) = y2(0) = p:p and the relation 


‘ov(t)-g lop(t)|=o(t) ast>0 (15.50) 


ler 
holds in each local coordinate system g : R” — U (or g: H” > U) whose range 
U contains p. Show that if (15.50) holds in one of these coordinate systems, then 
it holds in any other local coordinate system of the same type on the smooth mani- 
fold M. 
b) The property of being tangent at a point p € M is an equivalence relation on 
the set of smooth paths on M passing through p. We call an equivalence class a bun- 
dle of tangent paths at p € M. Establish the one-to-one correspondence exhibited 
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in Sect. 15.3.1 between vectors of TM, and bundles of tangent paths at the point 
pemM. 

c) Show that if the paths y; and y2 are tangent at p € M and f € C“)(M,R), 
then 


dfoy dfoy2 
0)= 
dt (0) dt 


(0). 


d) Show how to assign a functional / = /;(= De) : C™ (M,R)>R possessing 
properties (15.37) and (15.38), where xo = p, to each vector € ¢ TM y. A functional 
possessing these properties is called a derivation at the point p € M. 

Verify that differentiation / at the point p is a local operation, that is, if f1, fo € 
C©%) and f\(x) = f2(x) in some neighborhood of p, then /f, =Lf2. 

e) Show that if x!,..., x” are local coordinates in a neighborhood of the point 
p, then / = ye ) ae where aa is the operation of computing the partial 
derivative with respect to x’ at the point x corresponding to p. (Hint. Write 
the function f|y(p): M — R in local coordinates; remember that the expansion 
f(x) = f(0) + 77, x'gi(x) holds for the function f ¢ C(©°)(R",R), where 
gi € CR", R) and gj(0) = 440), i=1,...,n.) 

f) Verify that if M is a C‘©) manifold, then the vector space of derivations at 
the point p € M is isomorphic to the space TM, tangent to M at p constructed in 
Sect. 15.3.1. 


2. a) If we fix a vector €(p) € TM py at each point p € M of a smooth manifold M, 
we Say that a vector field is defined on the manifold M. Let X be a vector field on M. 
Since by the preceding problem every vector X (p) = & € TM, can be interpreted as 
differentiation at the corresponding point p, from any function f ¢ C°)(M, R) one 
can construct a function Xf (p) whose value at every point p € M can be computed 
by applying X (:p) to f, that is, to differentiating f with respect to the vector X (p) 
in the field X. A field X on M is smooth (of class C‘©)) if for every function 
f € C®)(M,R) the function Xf also belongs to C°°)(M, R). 

Give a local coordinate expression for a vector field and the coordinate definition 
of a smooth (C‘?) vector field on a smooth manifold equivalent to the one just 
given. 

b) Let X and Y be two smooth vector fields on the manifold M. For functions 
f € C‘~)(M,R) we construct the functional [X,Y] f = X(Yf) — Y(Xf). Verify 
that [X, Y] is also a smooth vector field on M. It is called the Poisson bracket of the 
vector fields X and Y. 

c) Give a Lie algebra structure to the smooth vector fields on a manifold. 


3. a) Let X and w be respectively a smooth vector field and a smooth 1-form on a 
smooth manifold M. Let wX denote the application of w to the vector of the field 
X at corresponding points of M. Show that wX is a smooth function on M. 

b) Taking account of Problem 2, show that the following relation holds: 


de! (X, Y) = X(w'Y) — Y(w'X) — wo! ([X, Y]), 
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where X and Y and smooth vector fields, dw! is the differential of the form !, 
and dw!(X, Y) is the application of dw! to pairs of vectors of the fields X and Y 
attached at the same point. 

c) Verify that the relation 


dw (X1, wes Xmti) = 


m+1 _ 
— YD Xi0(X1, re) Xi, wees Xm4i) + 
i=1 
SS EU oe Xb Mises Baie Bj Red) 


l<i<j<m+l1 


holds for the general case of a form w of order m. Here the frown —~ denotes an 
omitted term, [X;, X;] is the Poisson bracket of the fields X; and X;, and X;w 
represents differentiation of the function w(X,,..., Xx, i>---;Xm41) With respect to 
the vectors of the field X;. Since the Poisson bracket is invariantly defined, the 
resulting relation can be thought of as a rather complicated but invariant definition 
of the exterior differential operator d: 2 —> 92. 

d) Let w be a smooth m-form on a smooth n-dimensional manifold M. Let 
(€1,.--,&m+1)i be vectors in R” corresponding to the vectors &},...,&m41 © TM p 
in the chart g; : RR” — U C M. We denote by J7; the parallelepiped formed by the 
vectors (&,...,&m+1); in R”, and let AJ; be the parallelepiped spanned by the 
vectors (A&1,..., A&m41);. We denote the images g; (/7;) and g; (A/7;) of these par- 
allelepipeds in M by IT and AIT respectively. Show that 


1 
doth 2ei Eatin at | . 
(al) 


a0 Ant! 


4. a) Let f : M — N bea smooth mapping of a smooth m-dimensional manifold 
M into a smooth n-dimensional manifold N. Using the interpretation of a tangent 
vector to a manifold as a bundle of tangent paths (see Problem 1), construct the 
mapping fx(p) : TM, — TN fp) induced by f. 

b) Show that the mapping f, is linear and write it in corresponding local coor- 
dinates on the manifolds M and N. Explain why f,(p) is called the differential of 
f at p or the mapping tangent to f at that point. 

Let f be a diffeomorphism. Verify that f,[X,Y]=[f,.X, f.¥]. Here X and Y 
are vector fields on M and [., -] is their Poisson bracket (see Problem 2). 

c) As is known from Sect. 15.1, the tangent mapping /f(p) : TM)» > TNg=f,(p) 
of tangent spaces generates the adjoint mapping f*(p) of the conjugate spaces and 
in general a mapping of k-forms defined on TN (p) and TM py. 

Let w be a k-form on N. The k-form f*@ on M is defined by the relation 


(f*o)(p)(E1, -.-. &) = O(f (p)) (feb, feb), 
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where &1,...,& € TM. In this way a mapping f aaa 2*(N) > Q*(M) arises from 
the space 92*(N) of k-forms defined on N into the space ak (M) of k-forms defined 
on M. 

Verify the following properties of the mapping f*, assuming M and N are C©? 
manifolds: 


1° f* is a linear mapping; 

2° f*(1 Aor) = fro A f*or: 

3° do f* = f* od, that is d(f*w) = f* (dw); 
4 (pep) =jfo ft. 


d) Let M and N be smooth n-dimensional oriented manifolds and g: M > N 
a diffeomorphism of M onto N. Show that if @ is an n-form on N with compact 


support, then 
i o= | yo, 
y(M) M 


where c= { 1, if Q aaa orientation, 
—1, if g reverses orientation. 
e) Suppose A > B. The mapping i : B — A that assigns to each point x € B 


that same point as an element of A is called the canonical embedding of B in A. 

If m is a form on a manifold M and M’ is a submanifold of M, the canonical 
embedding i: M’ > M generates a form i*w on M’ called the restriction of w 
to M’. Show that the proper expression of Stokes’ formula (15.47) should be 


[w= / i*a, 
M aM 


where i : 0M — M is the canonical embedding of 0M in M, and the orientation of 
0M is induced from M. 


5. a) Let M be a smooth (C?) oriented n-dimensional manifold and 22 (M) the 
space of smooth (C‘?) n-forms with compact support on M. Show that there exists 
a unique mapping mu: 822 (M) — K having the following properties: 

1° the mapping i m is linear; 

YM ife:I"+UCMoCorg: Pave M) is a chart of an atlas defining the 
orientation of M, suppw C U, and w = a(x) dx! A---Adx" in the local coordinates 


x!,...,x" of this chart, then 


fo=f a(x) dx!,..., dx” (or f w= fi acar',....as"), 
M n M qn 


where the right-hand side contains the Riemann integral of the function a over the 
corresponding cube J” (or 7"), 

b) Can the mapping just exhibited always be extended to a mapping /, M: 
92"(M) — R of all smooth n-forms on M, retaining both of these properties? 

c) Using the fact that every open covering of the manifold M has an at most 
countable locally finite refinement and the fact that there exists a partition of unity 
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subordinate to any such covering (see Problem 9), define the integral of an n-form 
over an oriented smooth n-dimensional (not necessarily compact) manifold so that 
it has properties 1° and 2° above when applied to the forms for which the integral is 
finite. Show that for this integral formula (15.47) does not hold in general, and give 
conditions on w that are sufficient for (15.47) in the case when M = R” and in the 
case when M = H”. 


6. a) Using the theorem on existence and uniqueness of the solution of the differen- 
tial equation x = v(x) and also the smooth dependence of the solution on the initial 
data, show that a smooth bounded vector field v(x) € R” can be regarded as the ve- 
locity field of a steady-state flow. More precisely, show that there exists a family of 
diffeomorphisms ¢, : R” — R” depending smoothly on the parameter f (time) such 
that gy; (x) is an integral curve of the equation for each fixed value of x € R”, that is, 
a = v(¢;(x)) and go(x) = x. The mapping ¢g, : R” — R” obviously character- 
izes the displacement of the particles of the medium at time f. Verify that the family 
of mappings g : R” — R” is a one-parameter group of diffeomorphisms, that is, 
(G1)! = 9-1, and Pry 0 Gy = Gr, 41y- 

b) Let v be a vector field on R” and g; a one-parameter group of diffeomor- 
phisms of R” generated by v. Verify that the relation 


_ ol 
lim = (f(g) — FO) = Dow f 
holds for every smooth function f € C‘(R”, R). 

If we introduce the notation u(f) := D, f, in consistency with the notation of 
Problem 2, and recall that f o gy; =: gy; f, we can write 


er 
lim “(Gi f —f)@)=v(f)@). 
c) Differentiation of a smooth form w of any degree defined in R” along the 
field v is now naturally defined. To be specific, we set 


oe 
v(w)(x) := lim 7 (i w—)(x). 


The form v(@) is called the Lie derivative of the form w along the field v and 
usually denoted L,w. Define the Lie derivative Lyw of a form w along the field X 
on an arbitrary smooth manifold M. 

d) Show that the Lie derivative on a C‘°) manifold M has the following prop- 
erties. 

1° Ly isalocal operation, that is, if the fields X; and X2 and the forms @ and w2 
are equal in a neighborhood U C M of the point x, then (Lx, @ )(x) = (Lx,@2)(x). 

29 Ly Q*(M) C 2*(M). 

3° Ly: 2*(M) — @*(M) isa linear mapping for every k = 0, 1,2,.... 

4° Lx(@, A @2) = (Lx@1) A@2 + 01 A Ly@. 

5° If f € 2°(M), then Ly f =df(X) =: Xf. 

6° If f € 2°(M), then Lyd f =d(Xf). 
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e) Verify that the properties 1°-6° determine the operation Ly uniquely. 


7. Let X be a vector field and w a form of degree k on the smooth manifold M. 

The inner product of the field X and the form @ is the (k — 1)-form de- 
noted by ixw or X]|q@ and defined by the relation (ixw)(X1,..., Xx-1) := 
w(X, X1,..., Xk_-1), where X1,..., X,_, are vector fields on M. For 0-forms, that 
is, functions on M, we set X| f =0. 


a) Show that if the form w (more precisely, w|y) has the form 


4 
> iyi, () Ax"! A+ A dx = pai in A+++ A dx'k 


1<i, <-+-<ig<n 


in the local coordinates x!,...,x” of the chart g:R° ~>UCM,and X = x 
then 


ixo= kisi dx? A---Adx', 

b) Verify further that if df = 25 dx', thenixdf = X'25 = x(f)=Dyf. 

c) Let X(M) be the space of vector fields on the manifold M and 22(M) the 
ring of skew-symmetric forms on M. Show that there exists only one mapping 7 : 
X(M) x 2(M) > §2(M) having the following properties: 

19 i is a local operation, that is, if the fields X; and X2 and the forms w, and w2 
are equal in a neighborhood U of x € M, then (ix,@)(x) = (ix,@2)(x); 

2° ix(Q*(M)) c Q*"(M), 

So ig: 2*(M) — Q*-1(M) is a linear mapping; 

4° if wy € 2™(M) and w2 € 2*2(M), then ix(@ A @2) = ix@, A @2 + 
(-1)"'@1 Aixan; 

5° if w € 2'(M), then ixw = w(X), and if f € Q°(M), then iy f =0. 


8. Prove the following assertions. 


a) The operators d, ix, and Ly (see Problems 6 and 7) satisfy the so-called 
homotopy identity 


Ly =ixd+dix, (15.51) 
where X is any smooth vector field on the manifold. 
b) The Lie derivative commutes with d and ix, that is, 


Lxyod=doLy, Lx oix =ixyoLy. 


c) [Lx,iy] = ipx,y], [Lx, Ly] = Lyx,y], where, as always, [A, B] = Ao B — 
BoA for any operators A and B for which the expression A o B — Bo A is defined. 
In this case, all brackets [ , ] are defined. 

d) Ly fo= fLxw+df Aix, where f € 929(M) and w € 2*(M). 


(Hint. Part a) is the main part of the problem. It can be verified, for example, by 
induction on the degree of the form on which the operators act.) 
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15.4 Closed and Exact Forms on Manifolds 


15.4.1 Poincaré’s Theorem 


In this section we shall supplement what was said about closed and exact differential 
forms in Sect. 14.3 in connection with the theory of vector fields in R”. As before, 
92? (M) denotes the space of smooth real-valued forms of degree p on the smooth 
manifold M and 2(M) = i QP(M). 


Definition 1 The form w € 922?(M) is closed if dw = 0. 


Definition 2 The form w € 22?(M), p > 0, is exact if there exists a form a € 
@2?-1(M) such that w = da. 


The set of closed p-forms on the manifold M will be denoted Z?(M), and the 
set of exact p-forms on M will be denoted B?(M). 

The relation’ d(dw) = 0 holds for every form w € §2(M), which shows that 
Z?(M) > BP(M). We already know from Sect. 14.3 that this inclusion is gener- 
ally strict. 

The important question of the solvability (for a) of the equation da = w given 
the necessary condition dw = 0 on the form w turns out to be closely connected with 
the topological structure of the manifold M. This statement will be deciphered more 
completely below. 


Definition 3 We shall call a manifold M contractible (to the point x9 € M) or 
homotopic to a point if there exists a smooth mapping h: M x I — M where 
I={t €R|0<t <1} such that h(x, 1) =x and h(x, 0) =x. 


Example I The space IR” can be contracted to a point by the mapping h(x, t) = tx. 


Theorem 1 (Poincaré) Every closed (p + 1)-form (p = 0) on a manifold that is 
contractible to a point is exact. 


Proof The nontrivial part of the proof consists of the following “cylindrical” con- 
struction, which remains valid for every manifold M. 

Consider the “cylinder”, M x I, which is the direct product of M and the closed 
unit interval J, and the two mappings j; : M— M x I, where jj(x) = (x,1),i= 
0, 1, which identify M with the bases of the cylinder M x J. Then there naturally 
arise mappings j; : 2?(M x I) > Q?(M), reducing to the replacement of the 
variable t in a form of 2?(M x 1) by the value i (= 0, 1), and, of course, di = 0. 


7Depending on the way in which the operator d is introduced this property is either proved, in 
which case it is called the Poincaré lemma, or taken as part of the definition of the operator d. 
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We construct a linear operator K : 2?+!(M x I) > Q?(M), which we define 
on monomials as follows: 


K (a(x, t)dx!! A--- A dx'?+!) :=0, 
1 
K (a(x, t) dt Adx!! A+++ Adx!?) = (/ a(x, Har) dx A... Adx!?, 
0 


The main property of the operator K that we need is that the relation 
K (dw) + d(Kw) = jfw— jjo (15.52) 


holds for every form w € 2Pt1(M x 1). 

It suffices to verify this relation for monomials, since all the operators K, d, j/, 
and jg are linear. 

If w =a(x,t) dx" A--- A dx, then Kw = 0, d(Kw) = 0, and 


a 
oo a dt A dx'! A--- A dx'?*! + [terms not containing dr], 
loa ‘ : 
Kido) = (| ar) dit As Advirs! = 
0 ot 


= (a(x, 1) — a(x, 0)) dx A... Adxie! = j*w — jeo, 


and relation (15.52) is valid. 
If w=a(x,t)dt Adx'! A--- Adx'?, then jw = jj@ =0. Then 


a ; 
K(do) = K(= 0 Sar na na a 


io 


1 
7) : ; 
=-) (/ Pazar) ad Aes adr 
5 g dx!0 


1 
d(Ka) = a(({ a(x, nar) dx A-.- A ax'r) = 
0 


Ce) 1 . ; ; 
= a5 s(f ats) at) di! Ads! A Ads!” = 
ig oe 0 
' da i i i 
= 5 7 dt} dx"? Adx'! A+» Adx'?. 
ig 0 * 


Thus relation (15.52) holds in this case also. Now let M be a manifold that is 
contractible to the point x9 € M, leth: M x I > M be the mapping in Definition 3, 


8For the justification of the differentiation of the integral with respect to x’ in this last equality, 
see, for example, Sect. 17.1. 
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and let w be a (p + 1)-form on M. Then obviously ho j,; : M — M is the identity 
mapping and ho jo: M — xo is the mapping of M to the point xo, so that (jj o 
h*)w = @ and (jj 0 h*)w = 0. Hence it follows from (15.52) that in this case 


K (d(h*o)) + d(K (h*o)) =o. (15.53) 


If in addition w is aclosed form on M, then, since d(h*w) = h* (dw) = 0, we find 
by (15.53) that 


d(K (h*w)) =o. 


Thus the closed form w is the exterior derivative of the form a = K (h*w) € 
2?(M), that is, w is an exact form on M. 


Example 2 Let A, B, and C be smooth real-valued functions of the variables 
x,y,z € IR®. We ask how to solve the following system of equations for P, Q, 
and R: 


aR dQ 

op a 

la — an =B, (15.54) 
Oz Ox 

dQ oP 

ox ay | 


An obvious necessary condition for the consistency of the system (15.54) is that 
the functions A, B, and C satisfy the relation 


dA OB OC 0 
ax dy az” 
which is equivalent to saying that the form 


@=AdyAdz+ BdzAdx+Cdx Ady 


is closed in R?. 
The system (15.54) will have been solved if we find a form 


a=Pdx+Qdy+Rdz 
such that da = w. 


In accordance with the recipes explained in the proof of Theorem 1, and taking 
account of the mapping / constructed in Example |, we find, after simple computa- 
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tions, 
1 
a= K (h*a) = (/ A(tx, ty, tz)t ar) (y dz —zdy)+ 
0 
1 
+ (/ B(tx, ty, tz)t ir) (zdx —xdz) + 
0 


1 
+ (/ C(tx, ty, ray) (x dy — ydx). 
0 


One can also verify directly that da = w. 


Remark The amount of arbitrariness in the choice of a form @ satisfying the con- 
dition da = is usually considerable. Thus, along with a, any form a@ + dy will 
obviously also satisfy the same equation. 


By Theorem | any two forms a@ and 6 on a contractible manifold M satisfying 
da = dé = w differ by an exact form. Indeed, d(a — 6) = 0, that is, the form (a@ — 6) 
is closed on M and hence exact, by Theorem |. 


15.4.2 Homology and Cohomology 


By Poincaré’s theorem every closed form on a manifold is locally exact. But it is by 
no means always possible to glue these local primitives together to obtain a single 
form. Whether this can be done depends on the topological structure of the manifold. 
For example, the closed form in the punctured plane R*\0 given by w = eae ; 
studied in Sect. 14.3, is locally the differential of a function g = g(x, y) — the polar 
angle of the point (x, y). However, extending that function to the domain R7\0 leads 
to multivaluedness if the closed path over which the extension is carried out encloses 
the hole — the point 0. The situation is approximately the same with forms of other 
degrees. “Holes” in manifolds may be of different kinds, not only missing points, 
but also holes such as one finds in a torus or a pretzel. The structure of manifolds of 
higher dimensions can be rather complicated. The connection between the structure 
of a manifold as a topological space and the relationship between closed and exact 
forms on it is described by the so-called (co)homology groups of the manifold. 

The closed and exact real-valued forms on a manifold M form the vector spaces 
Z?(M) and B?(M) respectively, and Z?(M) > B?(M). 


Definition 4 The quotient space 
H?(M) := Z?(M)/B?(M) (15.55) 


is called the p-dimensional cohomology group of the manifold M (with real coeffi- 
cients). 
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Thus, two closed forms w,,@2 € Z?(M) lie in the same cohomology class, or 
are cohomologous, if w; — w2 € B?(M), that is, if they differ by an exact form. The 
cohomology class of the form w € Z?(M) will be denoted [w]. 

Since Z?(M) is the kernel of the operator d? : Q?(M) — 2?+!(M), and 
B?(M) is the image of the operator d?—! : 2?-!(M) > 2?(M), we often write 


H?(M) = Kerd? /Imd?~!. 


Computing cohomologies, as a rule, is difficult. However, certain trivial general 
observations can be made. 

It follows from Definition 4 that if p > dim M, then H?(M) =0. 

It follows from Poincaré’s theorem that if M is contractible then H? (M) = 0 for 
p>o. 

On any connected manifold M the group H°(M) is isomorphic to R, since 
H°(M) = Z°(M), and if df =0 holds for the function f : M — R ona connected 
manifold M, then f = const. 

Thus, for example, it results for R” that H?(R”) = 0 for p > O and H°(R") ~R. 
This assertion (up to the trivial last relation) is equivalent to Theorem | with M = 
R” and is also called Poincaré’s theorem. 

The so-called homology groups have a more visualizable geometrical relation to 
the manifold M. 


Definition 5 A smooth mapping c: 1? + M of the p-dimensional cube J Cc R? 
into the manifold M is called a singular p-cube on M. 


This is a direct generalization of the concept of a smooth path to the case of an 
arbitrary dimension p. In particular, a singular cube may consist of a mapping of 
the cube J to a single point. 


Definition 6 A p-chain (of singular cubes) on a manifold M is any finite formal 
linear combination )°, axcx of singular p-cubes on M with real coefficients. 


Like paths, singular cubes that can be obtained from each other by a diffeomor- 
phic change of the parametrization with positive Jacobian are regarded as equivalent 
and are identified. If such a change of parameter has negative Jacobian, then the cor- 
responding oppositely oriented singular cubes c and c_ are regarded as negatives of 
each other, and we set c_ = —c. 

The p-chains on M obviously form a vector space with respect to the standard 
operations of addition and multiplication by a real number. We denote this space by 
Cp(M). 


Definition 7 The boundary oI of the p-dimensional cube J? in R? is the (p — 1)- 
chain 


lp 
sh= >. Sa; (15.56) 


i=0 j=1 
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in R?, where cj; : 1 p-! _, RP is the mapping of the (p — 1)-dimensional cube 
into R? induced by the canonical embedding of the corresponding face of J? in R?. 
More precisely, if /?~! = {%¥ € R?-! |0 <x" <1,m=1,..., p—1}, thenc;; (x) = 
GO psiucgel a ak SR, 


It is easy to verify that this formal definition of the boundary of a cube agrees 
completely with the operation of taking the boundary of the standard oriented 
cube I? (see Sect. 12.3). 

Definition 8 The boundary dc of the singular p-cube c is the (p — 1)-chain 
1p 
dc i= Yd CEpiteo Cij- 
i=) j=1 


Definition 9 The boundary of a p-chain )>, a,c on the manifold M is the (p — 1)- 


chain 
0 63 asc) = [> ALOCK. 
k k 


Thus on any space of chains Cp(M) we have defined a linear operator 
d= 0p: Cp(M) > Cp-1(M). 


Using relation (15.56), one can verify the relation 0(07) = 0 for the cube. Con- 
sequently 0 o d = 0* = 0 in general. 


Definition 10 A p-cycle on a manifold is a p-chain z for which dz = 0. 


Definition 11 A boundary p-cycle on a manifold is a p-chain that is the boundary 
of some (p + 1)-chain. 


Let Z,(M) and B,(M) be the sets of p-cycles and boundary p-cycles on the 
manifold M. It is clear that Z,(M) and B,(M) are vector spaces over the field R 
and that Z,(M) > By(M). 


Definition 12 The quotient space 
Hy(M) := Zp(M)/Bp(M) (15.57) 
is the p-dimensional homology group of the manifold M (with real coefficients). 
Thus, two cycles z;, z2 € Zp(M) are in the same homology class, or are homol- 


ogous, if z1 — z2 € By(M), that is, they differ by the boundary of some chain. We 
shall denote the homology class of a cycle z € Zp(M) by [z]. 
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As in the case of cohomology, relation (15.57) can be rewritten as 
Hy(M) = Ker 0p/Im0p41. 


Definition 13 If c: J — M is a singular p-cube and w is a p-form on the mani- 
fold M, then the integral of the form w over this singular cube is 


fos [eto. (15.58) 
c I 


Definition 14 If 5°, axcx is a p-chain and w is a p-form on the manifold M, 
the integral of the form over such a chain is interpreted as the linear combination 
yp Ok J 0 of the integrals over the corresponding singular cubes. 


It follows from Definitions 5—8 and 13-14 that Stokes’ formula 


[oo= 0) (15.59) 
c dc 


holds for the integral over a singular cube, where c and w have dimension p and 
degree p — | respectively. If we take account of Definition 9, we conclude that 
Stokes’ formula (15.59) is valid for integrals over chains. 


Theorem 2 a) The integral of an exact form over a cycle equals zero. 

b) The integral of a closed form over the boundary of a chain equals zero. 

c) The integral of a closed form over a cycle depends only on the cohomology 
class of the form. 

d) If the closed p-forms @, and wz and the p-cycles z, and z2 are such that 
[@] = [@2] and [z1] = [za], then 


fof or. 
Z1 £2 


Proof a) By Stokes’ formula f, @dz = f,.@ = 0, since dz = 0. 
b) By Stokes’ formula fo = dw = 0, since dw = 0. 
c) follows from b). 
d) follows from a). 
e) follows from c) and d). 


Corollary The bilinear mapping 2?(M) x C,(M) —> R defined by (a,c) 
f.o induces a bilinear mapping Z?(M) x Z»)(M) — R and a bilinear mapping 
H?(M) x Hy(M) — R. The latter is given by the formula 


((o), [z]) / i (15.60) 


z 


where w € ZP(M) and z € Z,(M). 
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Theorem 3 (de Rham’) The bilinear mapping H?(M) x H,(M) — R given by 
(15.60) is nondegenerate.'° 


We shall not take the time to prove this theorem here, but we shall find some 
reformulations of it that will enable us to present in explicit form some corollaries 
of it that are used in analysis. 

We remark first of all that by (15.60) each cohomology class [w] € H?(M) 
can be interpreted as a linear function [w]([z]) = fo. Thus a natural mapping 
H?(M) > Hy(M) arises, where Hy(M) is the vector space conjugate to H)(M). 
The theorem of de Rham asserts that this mapping is an isomorphism, and in this 
sense H?(M) = H;(M). 


Definition 15 If @ is a closed p-form and z is a p-cycle on the manifold M, then 
the quantity per(z) := ie @ is called the period (or cyclic constant) of the form w 
over the cycle z. 


In particular, if the cycle z is homologous to zero, then, as follows from asser- 
tion b) of Theorem 2, we have per(z) = 0. For that reason the following connection 
exists between periods: 


| Srauce| =0=> )\ ax per(zx) =0, (15.61) 
k k 


that is, if a linear combination of cycles is a boundary cycle, or, what is the same, is 
homologous to zero, then the corresponding linear combination of periods is zero. 

The following two theorems of de Rham hold; taken together, they are equivalent 
to Theorem 3. 


Theorem 4 (de Rham’s first theorem) A closed form is exact if and only if all its 
periods are zero. 


Theorem 5 (de Rham’s second theorem) /f a number per(z) is assigned to each p- 


cycle z € Zp(M) on the manifold M in such a way that condition (15.61) holds, then 
there is a closed p-form w on M such that 3 w = per(z) for every cycle z € Z»)(M). 


15.4.3 Problems and Exercises 


1. Verify by direct computation that the form a obtained in Example 2 does indeed 
satisfy the equation da = w. 


°G. de Rham (1903-1969) — Belgian mathematician who worked mainly in algebraic topology. 


!0We recall that a bilinear form L(x, y) is nondegenerate if for every fixed nonzero value of one of 
the variables the resulting linear function of the other variable is not identically zero. 
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2. a) Prove that every simply-connected domain in R? is contractible on itself to a 
point. 
b) Show that the preceding assertion is generally not true in R?. 


3. Analyze the proof of Poincaré’s theorem and show that if the smooth mapping 
h:M x I — M is regarded as a family of mappings h; : M — M depending on the 
parameter f, then for every closed form w on M all the forms hw, t € I, will be in 
the same cohomology class. 

4. a) Let tr h; € C(M, N) be a family of mappings of the manifold M into 
the manifold N depending smoothly on the parameter t € J C R. Verify that for 
every form w € 92(N) the following homotopy formula holds: 


© (if) = dhi (ix@)(x) + At (ix dw)(x). (15.62) 
Here x € M, X isa vector field on N with X (x, t) € TNy, (x), X (x, £) is the velocity 
vector for the path t’ +> h,(x) at t’ =f, and the operation ix of taking the inner 
product of a form and a vector field is defined in Problem 7 of the preceding section. 

b) Obtain the assertion of Problem 3 from formula (15.62). 

c) Using formula (15.62), prove Poincaré’s theorem (Theorem 1) again. 

d) Show that if K is a manifold that is contractible to a point, then H?(K x 
M) = H?(M) for every manifold M and any integer p. 

e) Obtain relation (15.51) of Sect. 15.3 from formula (15.62). 


5. a) Show, using Theorem 4, and also by direct demonstration, that if a closed 
2-form on the sphere S? is such that J. Qo= 0, then @ is exact. 

b) Show that the group H?(S7) is isomorphic to R. 

c) Show that H!(S?) =0. 


6. a) Let g: S* > S? be the mapping that assigns to each point x € S* the antipo- 
dal point —x € S?. Show that there is a one-to-one correspondence between forms 
on the projective plane RP? and forms on the sphere S* that are invariant under the 
mapping 9, that is, p*w = w. 

b) Let us represent RP? as the quotient space S*/I", where I is the group of 
transformations of the sphere consisting of the identity mapping and the antipodal 
mapping g. Let 2 : S? > RP? = S?/T be the natural projection, that is 7(x) = 
{x, —x}. Show that z og =z and verify that 


Vn € 2?(S) (p*n =n) => Jw € Q?(RP*) (x*w=n). 


c) Now show, using the result of Problem 5a), that H 2(RP?) = 0. 
d) Prove that if the function f € C(S?,R) is such that f(x) — f(—*) = const, 
then f = 0. Taking account of Problem 5c), deduce from this that H : (RP?) = 0. 


7. a) Representing RP? as a standard rectangle IT with opposite sides identified as 
shown by the orienting arrows in Fig. 15.3, show that 0/7 = 2c’ — 2c, dc = P— Q, 
and dc’ = P—Q. 
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Fig, 15.3 Q P 
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b) Deduce from the observations in the preceding part of the problem that 
there are no nontrivial 2-cycles on RP*. Then show by de Rham’s theorem that 
H?(RP*) =0. 

c) Show that the only nontrivial 1-cycle on RP? (up to a constant factor) is 
the cycle c’ — c, and since c’ -c= 5917 , deduce from de Rham’s theorem that 
H'(RP?) =0. 

8. Find the groups H°(M), H!(M), and H?(M) if 


a) M=S ! _ the circle; 
b) M =T? — the two-dimensional torus; 
c) M = K? — the Klein bottle. 


9. a) Prove that diffeomorphic manifolds have isomorphic (co)homology groups 
of the corresponding dimension. 

b) Using the example of R? and RP”, show that the converse is generally not 
true. 


10. Let X and Y be vector spaces over the field R and L(x, y) a nondegenerate 
bilinear form L : X x Y > R. Consider the mapping X — Y* given by the corre- 
spondence X 3 xt L(x,-)€ Y*. 


a) Prove that this mapping is injective. 

b) Show that for every system yj,..., yx of linearly independent vectors in Y 
there exist vectors x!, oeag he such that x! (yj) = L(x', yp)p= 5, where 5 = Oif 
iA jandd,=1ifi=j. 

c) Verify that the mapping X — Y* is an isomorphism of the vector spaces X 
and Y*. 

d) Show that de Rham’s first and second theorems together mean that H?(M) = 
H;,(M) up to isomorphism. 


Chapter 16 
Uniform Convergence and the Basic Operations 
of Analysis on Series and Families of Functions 


16.1 Pointwise and Uniform Convergence 


16.1.1 Pointwise Convergence 


Definition 1 We say that the sequence { f,;n € N} of functions f, : X — R con- 
verges at the point x € X if the sequence of values at x, { fn(x);n € N}, converges. 


Definition 2 The set of points E Cc X at which the sequence { fn; € N} of func- 
tions f, : X — R converges is called the convergence set of the sequence. 


Definition 3 On the convergence set of the sequence of functions { fn; € N} 
there naturally arises a function f : E — R defined by the relation f(x) := 
limy—oo fn(x). This function is called the limit function of the sequence { fy; n € N} 
or the limit of the sequence { fy; n € N}. 


Definition 4 If f : E — R is the limit of the sequence { f,; n € N}, we say that the 
sequence of functions converges (or converges pointwise) to f on E. 


In this case we write f(x) = limy-+o0 fn(x) on E or fn > f on E asn—> oo. 


Example I Let X = {x € R| x > 0} and let the functions f, : X — R be given by 
the relation f,(x) =x”, n € N. The convergence set of this sequence of functions is 
obviously the closed interval J = [0, 1] and the limit function f : J > R is defined 
by 


0, if0<x <1, 


FO=)) yan, 


Sere 
sn”'~ on R converges on R to the 


Example 2 The sequence of functions f,(x) = = 


function f : R > 0 that is identically 0. 
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Example 3 The sequence f,(x) = sing also has the identically zero function f : 
R-— 0as its limit. 


Example 4 Consider the sequence f,(x) = 2(n + 1)x(1 — x)" on the closed inter- 
val I = [0, 1]. Since nq” — 0 for |q| < 1, this sequence tends to zero on the entire 
closed interval /. 


Example 5 Letm,n €N, and let f(x) := limy_-so0(cosm!ax)*”. If m!x is an inte- 
ger, then fin(x) = 1, and if m!x ¢ Z, obviously fin(x) = 0. 

We shall now consider the sequence { f,,; m € N} and show that it converges on 
the entire real line to the Dirichlet function 


pas oe 
1, ifxeQ. 
Indeed, if x ¢ Q, then m!x ¢ Z, and fin (x) = 0 for every value of m € N, so that 
f(x) =0. But if x = 4, where p € Z and q EN, then m!x € Z for m > q, and 
FSm(x) = 1 for all such m, which implies f(x) = 1. 
Thus limm—oo fin(x) = D(x). 


16.1.2 Statement of the Fundamental Problems 


Limiting passages are encountered at every step in analysis, and it is often impor- 
tant to know what kind of functional properties the limit function has. The most 
important properties for analysis are continuity, differentiability, and integrability. 
Hence it is important to determine whether the limit is a continuous, differentiable, 
or integrable function if the prelimit functions all have the corresponding property. 
Here it is especially important to find conditions that are sufficiently convenient in 
practice and which guarantee that when the functions converge, their derivatives or 
integrals also converge to the derivative or integral of the limit function. 

As the simple examples examined above show, without some additional hypothe- 
ses the relation “f, — f on [a, b] as n — oo” does not in general imply either the 
continuity of the limit function, even when the functions jf, are continuous, or the 
relation f; > f’ or p Sn(x) dx > iia J (x) dx, even when all these derivatives and 
integrals are defined. 

Indeed, 

in Example | the limit function is discontinuous on [0, 1] although all the prelimit 
functions are continuous there; 

in Example 2 the derivatives n cosn7x of the prelimit functions in general do not 
converge, and hence cannot converge to the derivative of the limit function, which 
in this case is identically zero; 


in Example 4 we have i Sfn(x) dx = 1 for every value of n € N, while 


fo F@)dx =0; 
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in Example 5 each of the functions f,,, equals zero except at a finite set of points, 
so that i, JSm(x) dx = 0 on every closed interval [a, b] C R, while the limit function 
D is not integrable on any closed interval of the real line. 

At the same time: 

in Examples 2, 3, and 4 both the prelimit and the limit functions are continuous; 

in Example 3 the limit of the derivatives °*"* of the functions in the sequence 


singe does equal the derivative of the limit of that sequence; 
in Example | we have fi Sn(x) dx > fis f(x) dx asn > oo. 
Our main purpose is to determine the cases in which the limiting passage under 


the integral or derivative sign is legal. 
In this connection, let us consider some more examples. 


Example 6 We know that for any x € R 


sinx =X 31" 51 Gis: Di” F i 


but after the examples we have just considered, we understand that the relations 


sy = (a) 2m+1 ’ 

sin Ge. 0 Di* ) ; (16.2) 
Soe) aa 1" 2mtl 

[ cae > Qm+D! pit dx, (16.3) 


require verification in general. 
Indeed, if the equality 


S(x) = ay (x) + an(x) +21 tame) +o 


is understood in the sense that S(x) = limy-+o0 Sy (x), where S,(x) = pen an (x), 
then by the linearity of differentiation and integration, the relations 


[e.e) 


SOs > 4, 


m=1 
[ syar= > f Am (x) dx 
7 m=1 


are equivalent to 
S'(x) = lim S/(x), 
noo 


b b 
i S(x)dx = tim, [ Sn (x) dx, 
n—>oo a 


a 


which we must now look upon with caution. 
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In this case both relations (16.2) and (16.3) can easily be verified, since it is 
known that 


1 1 —1)” 
cosx = 1 x24 7 (SD em 


ya" oor t 


However, suppose that Eq. (16.1) is the definition of the function sinx. After all, 
that was exactly the situation with the definition of the functions sin z, cos z, and 
e* for complex values of the argument. At that time we had to get the properties of 
the new function (its continuity, differentiability, and integrability), as well as the 
legality of the equalities (16.2) and (16.3) directly from the fact that this function is 
the limit of the sequence of partial sums of this series. 

The main concept by means of which sufficient conditions for the legality of the 
limiting passages will be derived in Sect. 16.3, is the concept of uniform conver- 
gence. 


16.1.3, Convergence and Uniform Convergence of a Family 
of Functions Depending on a Parameter 


In our discussion of the statement of the problems above we confined ourselves 
to consideration of the limit of a sequence of functions. A sequence of functions 
is the most important special case of a family of functions f;(x) depending on a 
parameter ¢. It arises when t € N. Sequences of functions thus occupy the same place 
occupied by the theory of limit of a sequence in the theory of limits of functions. 
We shall discuss the limit of a sequence of functions and the connected theory of 
convergence of series of functions in Sect. 16.2. Here we shall discuss only those 
concepts involving functions depending on a parameter that are basic for everything 
that follows. 


Definition 5 We call a function (x, tf) +> F(x, t) of two variables x and t defined 
on the set X x T a family of functions depending on the parameter t if one of the 
variables t € T is distinguished and called the parameter. 


The set T is called the parameter set or parameter domain, and the family it- 
self is often written in the form f;(x) or {f;;t € T}, distinguishing the parameter 
explicitly. 

As a rule, in this book we shall have to consider families of functions for which 
the parameter domain T is one of the sets N or R or C of natural numbers, real num- 
bers, or complex numbers or subsets of these. In general, however, the set T may be 
a set of any nature. Thus in Examples 1-5 above we had T = N. In Examples 14 
we could have assumed without loss of content that the parameter n is any positive 
number and the limit was taken over the base n > o0o,n€ R. 
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Definition 6 Let {f; : X > R;t € T} be a family of functions depending on a pa- 
rameter and let B be a base in the set T of parameter values. 

If the limit limy f;(x) exists for a fixed value x € X, we say that the family of 
functions converges at x. 

The set of points of convergence is called the convergence set of the family of 
functions in a given base B. 


Definition 7 We say that the family of functions converges on the set E C X over 
the base B if it converges over that base at each point x € E. 

The function f(x) := limg f;(x) on E is called the limit function or the limit of 
the family of functions f; on the set E over the base B. 


Example 7 Let f;(x) =e7*/9”, x € X =R,t € T =R\O, and let B be the base 
t — 0. This family converges on the entire set R, and 


lim fre) 1, ifx=0, 
im fi(x) = 
ps0 0, ifx 40. 
We now give two basic definitions. 


Definition 8 We say that the family { f;; t € T} of functions f; : X — R converges 
pointwise (or simply converges) on the set E C X over the base B to the function 
f:E— Rif limg f;(x) = f(x) at every point x € E. 


In this case we shall often write (f; ae f on E). 


Definition 9 The family {f:;t € T} of functions f; : X — R converges uniformly 
on the set E C X over the base B to the function f : E — R if for every ¢ > 0 there 
exists an element B in the base B such that | f(x) — f;(x)| < e at every value t € B 
and at every point x € E. 


In this case we shall frequently write (f; = f on E). 
B 


We give also the formal expression of these important definitions: 


(J; > fon £) := Ve > 0Vx € EAB E BYTE B (|f(x) — filx)| <e), 
(f= fon E) := Ve > 04B € BYx € Ete B (| f(x) — filx)| <e). 
B 


The relation between convergence and uniform convergence resembles the rela- 
tion between continuity and uniform continuity on a set. 

To explain better the relationship between convergence and uniform convergence 
of a family of functions, we introduce the quantity A;(x) = | f(x) — f¢(x)|, which 
measures the deviation of the value of the function jf; from the value of the func- 
tion f at the point x € E. Let us consider also the quantity A; = sup,e¢¢ Ar(x), 
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Fig. 16.1 


O} t 2 1 @ 


which characterizes, roughly speaking, the maximum deviation (although there may 
not be a maximum) of the function f; from the corresponding values of f over all 
x € E. Thus, at every point x € E we have A;(x) < A;. 

In this notation these definitions obviously can be written as follows: 


(f a fon E) =VWx EE (A; (x) — 0 over B), 
(f = f on E) := (A; > 0 over B). 
B 


It is now clear that 
(ff on E) => (fr fon), 
B 


that is, ifthe family f; converges uniformly to f on the set EF, it converges pointwise 
to f on that set. 
The converse is in general not true. 


Example 8 Let us consider the family of functions f; : J — R defined on the 
closed interval J = {x € R| 0 <x < 1} and depending on the parameter ¢ € 0, 1]. 
The graph of the functions y = f;(x) is shown in Fig. 16.1. It is clear that 
lim;_+0 ft(x) = 0 at every point x € J, that is, f; > f =O as t — 0. At the same 
time A; = supye; | f(x) — fi(®)| = supye; | fr(x)| = 1, that is, A; ~ 0 as t > 0, 
and hence the family converges, but not uniformly. 

In such cases we shall say for convenience that the family converges nonuni- 
formly to the limit function. 


If the parameter ¢ is interpreted as time, then convergence of the family of func- 
tions f; on the set E to the function f means that for any preassigned precision 
é > 0 one can exhibit a time ft, for each point x € F starting from which (that is, for 
t > t,) the values of all functions f; at x will differ from f(x) by less than e. 

Uniform convergence means that there is a time f,, starting from which (that is, 
for t > t,) the relation | f(x) — f;(x)| < € holds for all x € E. 

The figure of a traveling bulge of large deviation depicted in Fig. 16.1 is typical 
for nonuniform convergence. 
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Example 9 The sequence of functions f,(x) = x” — x2” defined on the closed in- 
terval 0 < x < 1, as one can see, converges to zero at each point as n > ov. 
To determine whether this convergence is uniform, we find the quantity A, = 
maxg<x<1 | fn(x)|. Since f/(x) = nx"—!(1 — 2x") =0 for x = 0 and x = 271/", 
it is clear that Ay = fy(2~!/") = 1/4. Thus A, 0 as n > oo and our sequence 
converges to the limit function f(x) = 0 nonuniformly. 


Example 10 The sequence of functions f;, = x” on the interval 0 < x < 1 converges 
to the function 
(x) 0, if0<x <1, 
ee 


nonuniformly, since for each n € N 


An = sup |f@)—A@)| = sup |F@)— f.)|= 


O0<x<1 
= sup |fr(x)|= sup |x”|=1. 
0<x<1 0<x<1 


Example 11 The sequence of functions f, (x) = sine studied in Example 2 con- 


verges to zero uniformly on the entire set IR as n — ow, since in this case 


1 


sinn2x 


|f@) — fa@)| =| fr@)| = 


— ’ 


n n 


that is, A, < 1/n, and hence A, — 0 asn— oo. 


16.1.4 The Cauchy Criterion for Uniform Convergence 


In Definition 9 we stated what it means for a family of functions f; to converge uni- 
formly on a set to a given function on that set. Usually, when the family of functions 
is defined the limit function is not yet known, so that it makes sense to adopt the 
following definition. 


Definition 10 We shall say that the family { f,; t € T} of functions f,: X — R con- 
verges on the set E C X uniformly over the base B if it converges on that set and the 
convergence to the resulting limit function is uniform in the sense of Definition 9. 


Theorem (Cauchy criterion for uniform convergence) Let { f;; t € T} be a family 
of functions f, : X — R depending on a parameter t € T, and B a base in T. 
A necessary and sufficient condition for the family { f;; t € T} to converge uniformly 
on the set E C X over the base B is that for every ¢ > 0 there exists an element B 
of the base B such that | f;,(x) — fi,(x)| < € for every value of the parameters 
ti, t2 € B and every point x € E. 
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In formal language this means that f; converges uniformly on E over the base 
B= >Ve>OABeBVh, ne BVx EE (\fi,(x) — fro(®)| <6). 


Proof Necessity. The necessity of these conditions is obvious, since if f: E > R 
is the limit function and f; = f on E over B, there exists an element B in the base 
B such that | f(x) — fi(x)| < ¢/2 for every t € B and every x € E. Then for every 
ti, t2 € B and every x € E we have 


fn @) — fo®)| = |F@) - fa@|+|f@ —- f,@)| <e/2+e/2=e. 


Sufficiency. For each fixed value of x € E we can regard f;(x) as a function of 
the variable t ¢ T. If the hypotheses of the theorem hold, then the hypotheses of 
the Cauchy convergence criterion for the existence of a limit over the base 6 are 
fulfilled. 


Hence, the family { f;; t € T} converges at least pointwise to some function f : 
E — R on the set E over the base B. 

If we now pass to the limit in the inequality | f;,(x) — fi,(x)| < €, which 
is valid for any t; and f2 € B and every x € E, one can obtain the inequality 
| f(x) — fp (x)| < € for every f2 € B and every x € E, and this, up to an inessential 
relabeling and the change of the strict inequality to the nonstrict, coincides exactly 
with the definition of uniform convergence of the family { f;; t € T} to the function 
f : £ — Ron the set E over the base B. 


Remark 1 The definitions of convergence and uniform convergence that we have 
given for families of real-valued functions f; : X — R of course remain valid for 
families of functions f; : X — Y with values in any metric space Y. The natural 
modification that one must make in the definitions in this case amounts to replacing 
| f(x) — fr(x)| by dy (f(x), f¢(x)), where dy is the metric in Y. 

For normed vector spaces Y, in particular for Y = C or Y= R” or Y= C”, even 
these formal changes are not needed. 


Remark 2 The Cauchy criterion of course remains valid for families of functions 
jit: X — Y with values in a metric space Y provided Y is a complete metric space. 
As can be seen from the proofs, the hypothesis that Y be complete is needed only 
for the sufficiency part of the criterion. 


16.1.5 Problems and Exercises 


1. Determine whether the sequences of functions considered in Examples 3-5 con- 
verge uniformly. 

2. Prove Eqs. (16.2) and (16.3). 

3. a) Show that the sequence of functions considered in Example | converges uni- 
formly on every closed interval [0, 1 — 6] c [0, 1], but converges nonuniformly on 
the interval [0, I[. 
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b) Show that the same is true for the sequence considered in Example 9. 

c) Show that family of functions f; considered in Example 8 converges uni- 
formly as t > 0 on every closed interval [5, 1] C [0, 1] but nonuniformly on [0, 1]. 

d) Investigate the convergence and uniform convergence of the family of func- 
tions f;(x) = sin(tx) as t > 0 and then as t > oo. 


tx 


2 
e) Characterize the convergence of the family of functions f;(x«) =e '* ast —> 


+oo on an arbitrary fixed set E CR. 


4. a) Verify that if a family of functions converges (resp. converges uniformly) on 
a set, then it also converges (resp. converges uniformly) on any subset of the set. 

b) Show that if the family of functions f; : X — R converges (resp. converges 
uniformly) on a set E over a base 6 and g: X — R is a bounded function, then 
the family g - f; : X — R also converges (resp. converges uniformly) on E over the 
base B. 

c) Prove that if the families of functions f; : X > R, g; : X — R converge uni- 
formly on E C X over the base B, then the family h; = af; + Bg;, where a, B € R, 
also converges uniformly on E over B. 


5. a) In the proof of the sufficiency of the Cauchy criterion we passed to the limit 
limg ft, («) = f(x) over the base B in T. But t) € B, and B is a base in T, not in B. 
Can we pass to this limit in such a way that f; remains in B? 

b) Explain where the completeness of IR was used in the proof of the Cauchy 
criterion for uniform convergence of a family of functions f;: X > R. 

c) Notice that if all the functions of the family {f; : X — R;t € T} are constant, 
then the theorem proved above is precisely the Cauchy criterion for the existence of 
the limit of the function g : T > R over the base B in T. 


6. Prove that if the family of continuous functions f; € C(/, R) on the closed inter- 
val J = {x € R| a < x < b} converges uniformly on the open interval Ja, b[, then it 
converges uniformly on the entire closed interval [a, b]. 


16.2 Uniform Convergence of Series of Functions 


16.2.1 Basic Definitions and a Test for Uniform Convergence 
of a Series 


Definition 1 Let {a, : X — C; n € N} bea sequence of complex-valued (in particu- 
lar real-valued) functions. The series )-°° , dn (x) converges or converges uniformly 
on the set E C X if the sequence {s(x) = )°¥"_, dn(x); n € N} converges or con- 
verges uniformly on E. 


Definition 2 The function s(x) = )-""_; an(x), as in the case of numerical se- 


ries, is called the partial sum or, more precisely, the mth partial sum of the series 


bea): 
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Definition 3 The sum of the series is the limit of the sequence of its partial sums. 
Thus, writing 


s(x) = Yo an(x) on EF 


n=1 
means that s(x) > s(x) on E as m — o, and writing 


CO 
the series ~ a,(x) converges uniformly on E 


n=1 


means that s;,(x) = s(x) on E asm —> co. 
Investigating the pointwise convergence of a series amounts to investigating the 
convergence of a numerical series, and we are already familiar with that. 


Example I Earlier we defined the function exp : C > C by the relation 


[oe 
1 
expz:= Ss ie (16.4) 
n=0 ~ 


after first verifying that the series on the right converges for every value z € C. 

In the language of Definitions 1-3 one can now say that the series (16.4) of 
functions ay(z) = azn converges on the entire complex plane, and the function 
exp z is its sum. 

By Definitions | and 2 just adopted a two-way connection is established between 
series and their sequences of partial sums: knowing the terms of the series, we obtain 
the sequence of partial sums, and knowing the sequence of partial sums, we can 
recover all the terms of the series: the nature of the convergence of the series is 
identified with the nature of the convergence of its sequence of partial sums. 


Example 2 In Example 5 of Sect. 16.1 we constructed a sequence { f;,; 7m € N} of 
functions that converge to the Dirichlet function D(x) on R. If we set aj (x) = fi (x) 
and an(x) = fn(x) — fn—1(x) for n > 1, we obtain a series pS ay,(x) that will 
converge on the entire number line, and bead an(x) = D(x). 


Example 3 It was shown in Example 9 of Sect. 16.1 that the sequence of functions 
fn(x) = x" — x?” converges, but nonuniformly, to zero on the closed interval [0, 1]. 
Hence, setting a,(x) = fi (x) and a, (x) = f(x) — fn_1(x) for n > 1, we obtain a 
series peed 1 @n(x) that converges to zero on the closed interval [0, 1], but converges 
nonuniformly. 

The direct connection between series and sequences of functions makes it pos- 
sible to restate every proposition about sequences of functions as a corresponding 
proposition about series of functions. 

Thus, in application to the sequence {s, : X — C;n € N} the Cauchy criterion 
proved in Sect. 16.1 for uniform convergence of a sequence on a set E C X means 
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that 
Ve >04N EN Vnj,n2 > N Vx €E (Sn, (0) — Spy (x)| <e). (16.5) 


From this, taking account of Definition 1, we obtain the following theorem. 


Theorem 1 (Cauchy criterion for uniform convergence of a series) The series 
ye n(x) converges uniformly on a set E if and only if for every ¢ > 0 there 
exists N € N such that 


|an(x) +++» +.am(x)| <e, (16.6) 
for all natural numbers m, n satisfying m >n > N and every point x € E. 
Proof Indeed, setting nj =m, nz =n — 1 in (16.5) and assuming that s,(x) is the 


partial sum of the series, we obtain inequality (16.6), from which relation (16.5) in 
turn follows with the same notation and hypotheses of the theorem. 


Remark 1 We did not mention the range of values of the functions a,(x) in the 
statement of Theorem |, taking for granted that it was R or C. But actually the 
range of values could obviously be any normed vector space, for example, R” or C”, 
provided only that the space is complete. 


Remark 2 If under the hypotheses of Theorem | all the functions a,(x) are con- 
stant, we obtain the familiar Cauchy criterion for convergence of a numerical series 


pea Gn. 


Corollary 1 (Necessary condition for uniform convergence of a series) A necessary 
condition for the series )-°_, an(x) to converge uniformly ona set E is that ay = 0 
on Easn— Oo. 


Proof This follows from the definition of uniform convergence of a sequence to 
zero and inequality (16.6) if we set m =n in it. 


Example 4 The series (16.4) converges on the complex plane C nonuniformly, since 
SUP,cc |4z"| = 00 for every n € N, while by the necessary condition for uniform 
convergence, the quantity sup, |an(x)| must tend to zero when uniform conver- 
gence occurs. 


Example 5 The series }~~_, z, as we know, converges in the unit disk K = {z€ 
C| |z| < 1}. Since [=| < i for z € K, we have x =30o0n K asn > ov. The neces- 
sary condition for uniform convergence is satisfied; however, this series converges 
nonuniformly on K. In fact, for any fixed n € N, by the continuity of the terms of 


the series, if z is sufficiently close to 1, we can get the inequalities 


1 
a5 


4 


eo 
n 2n 
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From this we conclude by the Cauchy criterion that the series does not converge 
uniformly on K. 


16.2.2 The Weierstrass M-Test for Uniform Convergence 
of a Series 


Definition 4 The series 77° | an (x) converges absolutely on the set E if the corre- 
sponding numerical series converges absolutely at each point x € E. 


Proposition 1 If the series \ °°, an(x) and Y°°°., by(x) are such that \ay(x)| < 
byn(x) for every x € E and for all sufficiently large indices n € N, then the uniform 
convergence of the series )~?-_, bn(x) on E implies the absolute and uniform con- 
vergence of the series \~°-_; an(x) on the same set E. 


Proof Under these assumptions for all sufficiently large indices n and m (let n < m) 
at each point x € E we have 


lan (x) + +++ +m (x)| < |an(x)| + +++ + lam (x)| < 
Sdn(x) +--+ + dm (x) = [bn (x) +--+ + Dm (x)]. 


By the Cauchy criterion and the uniform convergence of the series )-°°_, bn (x), 
for each ¢ > O we can exhibit an index N € N such that |b, (x) +--- + dn(x)| <e 
for all m >n> N and all x € E. But then it follows from the inequalities just 
written and the Cauchy criterion that the series bea 1 n(x) and eae |a,(x)| both 
converge uniformly. 


Corollary 2 (Weierstrass’ M-test for uniform convergence of a series) If for the 
series ) Deak An(x) one can exhibit a convergent numerical series Salt M,, such 
that sup,¢¢ |an(x)| < My, for all sufficiently large indices n € N, then the series 
ye | n(x) converges absolutely and uniformly on the set E. 


Proof The convergent numerical series can be regarded as a series of constant func- 
tions on the set E, which by the Cauchy criterion converges uniformly on EF. Hence 
the Weierstrass test follows from Proposition | if we set by (x) = M, in it. 


The Weierstrass M-test is the simplest and at the same time the most frequently 
used sufficient condition for uniform convergence of a series. 
As an example of its application, we prove the following useful fact. 


Proposition 2 If a power series \--° 9 Cn(z — zo)" converges at a point ¢ # zo, 
then it converges absolutely and uniformly in any disk Kg = {z € C | |z — Zol < 
a\¢ —zol}, whereO <q <1. 
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Proof By the necessary condition for convergence of a numerical series it fol- 
lows from the convergence of the series year Cn(E — zo)" that c,(¢ — z)" > 0 
as n — oo. Hence for all sufficiently large values of n € N we have the estimates 
len(z — 20)"| = len(S — z0)"| - ERI" S len(S — z0)"|-q" <q” in the disk Kg. 
Since the series )°°° 9 q" converges for |q| < 1, the estimates |cn(z — zo)"| <q” 
and the Weierstrass M-test now imply Proposition 2. 


Comparing this proposition with the Cauchy—Hadamard formula for the radius 
of convergence of a power series (see Eq. (5.115)), we arrive at the following con- 
clusion. 


Theorem 2 (Nature of convergence of a power series) A power series geal Cn(z- 
zo)" converges in the disk K = {z€C| |z — zo| < R} whose radius of convergence 
is determined by the Cauchy-Hadamard formula! R = (limy-soo */\€n|)~! Outside 
this disk the series diverges. On any closed disk contained in the interior of the 
disk K of convergence of the series, a power series converges absolutely and uni- 
formly. 


Remark 3 As Examples | and 5 show, the power series need not converge uniformly 
on the entire disk K. At the same time, it may happen that the power series does 
converge uniformly even on the closed disk K. 


Example 6 The radius of convergence of the series }°°°_, ° is 1. But if |z| <1, 
then IS < = and by the Weierstrass M-test this series converges absolutely and 
uniformly in the closed disk K = {z € C| |z| < 1}. 


16.2.3 The Abel-Dirichlet Test 


The following pairs of related sufficient conditions for uniform convergence of a 
series are somewhat more specialized and are essentially connected with the real- 
valuedness of certain components of the series under consideration. But these con- 
ditions are more delicate than the Weierstrass M-test, since they make it possible to 
investigate series that converge, but nonabsolutely. 


Definition 5 The family F of functions f : X — C is uniformly bounded on a set 
E C X if there exists a number M € R such that sup,<,|f(x)| < M for every 
fe. 


'Tn the exceptional case when limn—oo 7/en] = 00, we take R = 0 and the disk K degenerates to 
the single point zo. 
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Definition 6 The sequence of functions {b, : X — R;n € N} is called non- 
decreasing (resp. nonincreasing) on the set E C X if the numerical sequence 
{b, (x); n € N} is nondecreasing (resp. nonincreasing) for every x € E. Nondecreas- 
ing and nonincreasing sequences of functions on set are called monotonic sequences 
on the set. 


We recall (if necessary, see Sect. 5.2.3) the following identity, called Abel’ s trans- 
formation: 


m m—1 
Yo agbe = Ambm — An—tbn + 9) Ax (be = bet), (16.7) 
k=n k=n 
where ay = Ag — Ag_1, kK =n,...,m. 
If bn, bn41,-.-,bm iS a monotonic sequence of real numbers, then, even if 
An, An+1,+--,@m are complex numbers or vectors of a normed space, one can obtain 


the following estimate, which we need, from the identity (16.7): 


m 


Saxby <4 max |Ag|-max{|dnl, |bnl}- (16.8) 
n—l<k<m 
k=n 
Proof In fact, 
m—1 
|Ambm| + |An—1bnl + | >> Ande — be—-1)| < 
k=n 
m—1 
= Axl: | 12, —b = 
max |Aal ( ml + Ia + De wal) 
=n 


max |Ax|- (Ibm + |Bn| + [bn — bm|) = 


n—l<k<m 


<4 max |Ag|- max (|Dnl, |Dml)- 
n—l<k<m 


In the equality that occurs in this computation we used the monotonicity of the 
numerical sequence bx. 


Proposition 3 (The Abel—Dirichlet test for uniform convergence) A sufficient con- 
dition for uniform convergence on E of a series Y~-°_) an(x)bn(x) whose terms 
are products of complex-valued functions ay : X — C and real-valued functions 
by : X — R is that either of the following pairs of hypotheses be satisfied: 


a1) the partial sums sx(x) = ~ an(x) of the series ee ay(x) are uni- 
formly bounded on E; 

Bi) the sequence of functions b,(x) tends monotonically and uniformly to zero 
on E; 
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or 


a2) the series pag, ay (x) converges uniformly on E; 
B2) the sequence of functions by (x) is monotonic and uniformly bounded on E. 


Proof The monotonicity of the sequence b, (x) allows us to write an estimate anal- 
ogous to (16.8) for each x € E: 


m 


So ag x) de (x) 


k=n 


Din (x) 


i (16.8') 


’ 


<4 max |Ag(x)|-max{|bn(x) 
n—l<k<m 


where we take 5x (x) — Sp—1(x) as Ag(X). 

If the hypotheses a1) and 61) hold, then, on the one hand, there exists a constant 
M such that |A;(x)| < M for all k € N and all x € E, while on the other hand, for 
any number ¢ > 0 we have max{|bn(x)|, |Bm(x)|} < a47 for all sufficiently large n 
and m and all x € E. Hence it follows from (16.8) that | )°y__,, ax(x)be(x)| < € for 
all sufficiently large n and m and all x € E, that is, the Cauchy criterion holds for 
this series. 

In the case of hypotheses a2) and 62) the quantity max{|b,(x)|, |bm(x)|} is 
bounded. At the same time, by the uniform convergence of the series yy ay (x) 
and the Cauchy criterion, for every ¢ > 0 we have |Ag(x)| = |sx(x) — Sn—-1(x)| < & 
for all sufficiently large n and k > n and all x € E. Taking this into account, we 
again conclude from (16.8) that the Cauchy criterion for uniform convergence holds 
for this series. 


Remark 4 In the case when the functions a, and b, are constants Proposition 3 
becomes the Abel—Dirichlet criterion for convergence of numerical series. 


Example 7 Let us consider the convergence of the series 


oo oa 
b> ae (16.9) 
n=1 
Since 
| 1 
ae =—, (16.10) 
n n 


the necessary condition for uniform convergence does not hold for the series (16.9) 
when a@ < 0, and it diverges for every x € R. Thus we shall assume a > 0 from now 
on. 

If w > 1, we conclude from the Weierstrass M-test and (16.10) that the series 
(16.9) converges absolutely and uniformly on the entire real line R. 

To study the convergence for 0 < a < | we use the Abel—Dirichlet test, setting 
Gn(x) = e!”* and by(x) = a. Since the constant functions b,(x) are monotonic 
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when a > 0 and obviously tend to zero uniformly for x € R, it remains only to 
investigate the partial sums of the series )°°°, e!”*. 
For convenience in citing results below, we shall consider the sums }*7_)e 
which differ from the sums of our series only in the first term, which is 1. 
Using the formula for the sum of a finite geometric series and Euler’s formula, 
we obtain successively for x 4 27m, m € Z, 


ikx 


ee eimtlx _ 1 sin 2! y ets 
eres = 2 : — 
= ex — ] sin 5 el? 
sin “41x ihy sin “ty n on 
= 2° = cos —x +i sin =x }. (16.11) 
sin 5 sin 5 2 2 
2 2 
Hence, for every n € N 
” 1 
ee | Ses (16.12) 
| sin 5| 
k=0 2 


from which it follows by the Abel—Dirichlet criterion that for 0 < a < | the series 
(16.9) converges uniformly on every set E C R on which inf,eg|sin >| > 0. In 
particular the series (16.9) simply converges for every x 4 27m, m € Z. If a = 
2m, then e!”2"” = 1, and the series (16.9) becomes the numerical series pee 
which diverges for0 <a <1. 

We shall show that from what has been said, one can conclude that for 0 <a < 1 
the series (16.9) cannot converge uniformly on any set E whose closure con- 
tains ponte of the form 27m, m € Z. For definiteness, suppose 0 € E. The series 
pee a diverges for 0 < a < 1. By the Cauchy criterion, there exists ¢ > 0 such 
that for every N €N, no matter how large, one can find numbers m >n > N such 
that | a feet al > &9 > 0. By the continuity of the functions e!** on R, it follows 
that one can choose a point x € E close enough to 0 so that 


n= la 


e! nx e! mx 
n® m* 

But by the Cauchy criterion for uniform convergence this means that the series 
(16.9) cannot converge uniformly on E. 


To supplement what has just been said, we note that, as one can see from (16.10), 
the series (16.9) converges nonabsolutely for 0 <a <1. 


Remark 5 It is useful for what follows to remark that, separating the real and imag- 
inary parts in (16.11), we obtain the following relations: 


n n+l 


COS 5X - sin ae x 
Y \coskx = = ae eae a (16.13) 
sin + 
k=0 2 
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sin aa sin nt y 
Saree =— 2 (16.14) 
sin 
k=0 2 


which hold for x 4 27m, m € Z. 


As another example of the use of the Abel—Dirichlet test we prove the following 
proposition. 


Proposition 4 (The so-called second Abel theorem on power series) If a power 
series )-° 9 Cn(z — zo)" converges at a point ¢ € C, then it converges uniformly on 
the closed interval with endpoints zo and ¢. 


Proof We represent the points of this interval in the form zo + (¢ — zo)t, where 
0 < + < 1. Substituting this expression in the power series, we obtain the series 
0 en(E — Zo)"t". By hypothesis, the numerical series )°° 9 cn(€ — zo)” con- 
verges, and the sequence of functions t” is monotonic and uniformly bounded on 
the closed interval [0, 1]. Hence conditions a2) and 2) in the Abel—Dirichlet test 
are satisfied, and the proposition is proved. 


16.2.4 Problems and Exercises 


1. Investigate the nature of the convergence on the sets E C R for different values 
of the real parameter a in the following series: 


[o,@) COS NX 

a) a “ye * 
sinnx 

b) ea 1 one: 


2. Prove that the eftoving series converge uniformly on the indicated sets: 
ay yes CO" x" for0<x <1. 
eee cy e-"® for 0 <x < +00. 
ye Re ” for 0 < x < +00. 


3. Show that if a Dirichlet series )°”°., converges at a point xo € R, then it 


n=1 n* 
converges uniformly on the set x > xo and absolutely if x > x9 + 1. 


= (-1)"71 x2 : . 
4. Verify that the series °° , ar converges uniformly on R, and the series 
lee) x2 : 
ye Gixe Converges on R, but nonuniformly. 


5. a) Using the example of the series from Problem 2, show that the Weierstrass 
M-test is a sufficient condition but not a necessary one for the uniform convergence 
of a series. 

b) Construct a series pee 1 2n(X) with nonnegative terms that are continuous on 
the closed interval 0 < x < | and which converges uniformly on that closed inter- 
val, while the series pain , M, formed from the quantities M = maxo<y< |dn(x)| 
diverges. 
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6. a) State the Abel—Dirichlet test for convergence of a series mentioned in Re- 
mark 4. 

b) Show that the condition that {b,} be monotonic in the Abel—Dirichlet test 
can be weakened slightly, requiring only that the sequence {b,} be monotonic up to 
corrections {8,} forming an absolutely convergent series. 


7. As a supplement to Proposition 4 shows, following Abel, that if a power series 
converges at a boundary point of the disk of convergence, its sum has a limit in that 
disk when the point is approached along any direction not tangential to the boundary 
circle. 


16.3 Functional Properties of a Limit Function 


16.3.1 Specifics of the Problem 


In this section we shall give answers to the questions posed in Sect. 16.1 as to when 
the limit of a family of continuous, differentiable, or integrable functions is a func- 
tion having the same property, and when the limit of the derivatives or integrals of 
the functions equals the derivative or integral of the limiting function of the family. 

To explain the mathematical content of these questions, let us consider, for ex- 
ample, the connection between continuity and passage to the limit. 

Let fn(x) > f(x) on R as n > ov, and suppose that all the functions in the 
sequence { f,: n € N} are continuous at the point x9 € IR. We are interested in the 
continuity of the limit function f at the same point x9. To answer that question, we 
need to verify the equality lim,_,,, f(x) = f (xo), which in terms of the original se- 
quence can be rewritten as the relation lim, x, (liMp—oo fn(*)) = limn—+oo fn(xo), 
or, taking account of the given continuity of f, at xo, as the following relation, 
subject to verification: 

lim ( lim fy (x)) = lim ( lim Iul)). (16.15) 
x—>xo \n—>0o n—>oo \x>x9 

On the left-hand side here the limit is first taken over the base n — oo, then over 
the base x — xo, while on the right-hand side the limits over the same bases are 
taken in the opposite order. 

When studying functions of several variables we saw that Eq. (16.15) is by no 
means always true. We also saw this in the examples studied in the two preceding 
sections, which show that the limit of a sequence of continuous functions is not 
always continuous. 

Differentiation and integration are special operations involving passage to the 
limit. Hence the question whether we get the same result if we first differentiate 
(or integrate) the functions of a family, then pass to the limit over the parameter 
of the family or first find the limit function of the family and then differentiate (or 
integrate) again reduces to verifying the possibility of changing the order of two 
limiting passages. 
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16.3.2 Conditions for Two Limiting Passages to Commute 


We shall show that if at least one of two limiting passages is uniform, then the 
limiting passages commute. 


Theorem 1 Let {F;;t € T} be a family of functions F,: X — C depending on a 
parameter t; let By be a base in X and Br a base in T . If the family converges uni- 
formly on X over the base Br to a function F : X > C and the limit limp, F;(x) = 
A, exists for each t € T, then both repeated limits limp, (limg, F;(x)) and 
limg, (img, F;(x)) exist and the equality 


Xx 


lim (tim F, (x)) = lim (tim F, (x)) (16.16) 
holds. 


This theorem can be conveniently written as the following diagram 


F,(x) =~ F(x) (16.17) 


Br 7 
Bx | a 2 | o 
ra 
A; ———— A 


Br 


in which the hypotheses are written above the diagonal and the consequences below 
it. Equality (16.16) means that this diagram is commutative, that is, the final result 
A is the same whether the operations corresponding to passage over the upper and 
right-hand sides are carried out or one first passes down the left-hand side and then 
to the right over the lower side. 

Let us prove this theorem. 


Proof Since F; = F on X over Br, by the Cauchy criterion, for every ¢ > 0 there 
exists Br in Br such that 
| Fi, (x) — Fy (x)| <e (16.18) 
for every t,, t2 € Br and every x € X. 
Passing to the limit over By in this inequality, we obtain the relation 


|Ar, — An| <6, (16.19) 


which holds for every t), t2 € Br. By the Cauchy criterion for existence of the limit 
of a function it now follows that A; has a certain limit A over By. We now verify 
that A = limp, F(x). 
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Fixing ft) € Br, we find an element By in By such that 
| Fi,(x) — An| <e (16.20) 


for all x € By. 
Keeping f2 fixed, we pass to the limit in (16.18) and (16.19) over By with respect 
to t;. We then find 


|F(x) — Fy(x)| <e, (16.21) 
|A—A,| <e, (16.22) 


and (16.22) holds for all x € X. 
Comparing (16.20)-(16.22), and using the triangle inequality, we find 


| F(x) — A] <3e 


for every x € By. We have thus verified that A = limg, F(x). 


Remark 1 As the proof shows, Theorem | remains valid for functions F; : X > Y 
with values in any complete metric space. 


Remark 2 If we add the requirement that the limit limg, A; = A exists to the hy- 
potheses of Theorem |, then, as the proof shows, the equality limp, F(x) = A 
can be obtained even without assuming that the space Y of values of the functions 
F,: X — Y is complete. 


16.3.3 Continuity and Passage to the Limit 


We shall show that if functions that are continuous at a point of a set converge 
uniformly on that set, then the limit function is also continuous at that point. 


Theorem 2 Let { f;;t € T} be a family of functions f;,: X — C depending on the 
parameter t; let B be a base in T . If f; = f on X over the base B and the functions 
ft are continuous at x9 € X, then the function f : X — C is also continuous at that 


point. 


Proof 1n this case the diagram (16.17) assumes the following specific form: 


f(x) ——3 fe) 


B. + 
Zz 
X—>x0 | # | X—>x0 
” 
Zz 


fi (xo) or f (xo) 
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Here all the limiting passages except the vertical passage on the right are defined 
by the hypotheses of Theorem 2 itself. The nontrivial conclusion of Theorem | that 
we need is precisely that lim; , f(x) = f (xo). 


Remark 3 We have not said anything specific as to the nature of the set X. In fact it 
may be any topological space provided the base x — xo is defined in it. The values 
of the functions f; may lie in any metric space, which, as follows from Remark 2, 
need not even be complete. 


Corollary 1 [fa sequence of functions that are continuous on a set converges uni- 
formly on that set, then the limit function is continuous on the set. 


Corollary 2 [fa series of functions that are continuous on a set converges uniformly 
on that set, then the sum of the series is also continuous on the set. 


As an illustration of the possible use of these results, consider the following. 


Example I Abel’s method of summing series. 
Comparing Corollary 2 with Abel’s second theorem (Proposition 4 of Sect. 16.2), 
we draw the following conclusion. 


Proposition 1 If a power series Yr.) Cn(z — zo)" converges at a point ©, it con- 
verges uniformly on the closed interval (zo, ¢| from zo to €, and the sum of the series 
is continuous on that interval. 


In particular, this means that if a numerical series pete Cn converges, then the 
power series }*° 4 cnx” converges uniformly on the closed interval 0 < x < 1 of 
the real axis and its sum s(x) = pie C,x" is continuous on that interval. Since 
sql) = an Cn, we can thus assert that if the series yO Cn converges, then the 
following equality holds: 


> Co = lim ; oz Cax”. (16.23) 


It is interesting that the right-hand side of Eq. (16.23) may have a meaning even 
when the series on the left diverges in its traditional sense. For example, the series 
1—1+1-—--- corresponds to the series x — x* + x3 —---, which converges to 
x/(1+-~x) for |x| < 1. As x — 1, this function has the limit 1/2. 

The method of summing a series known as Abel summation consists of ascribing 
to the left-hand side of (16.23) the value of the right-hand side if it is defined. We 
have seen that if the series yc Cn converges in the traditional sense, then its clas- 
sical sum will be assigned to it by Abel summation. At the same time, for example, 
Abel’s method assigns to the series )~°°_)(—1)", which diverges in the traditional 
sense, the natural average value 1/2. 

Further questions connected with Example | can be found in Problems 5-8 be- 
low. 
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Example 2 Earlier, when discussing Taylor’s formula, we showed that the following 
expansion holds: 


-1 Shas 1 
(taytait te ¢ MEO. 4 ) S Jaa ) na. ; 
(16.24) 


We can verify that for a > 0 the numerical series 
a a(a—l) ee ie rl 


a a ee = 


converges. Hence by Abel’s theorem, if a > 0, the series (16.24) converges uni- 
formly on the closed interval 0 < x < 1. But the function (1 + x)® is continuous at 
x = 1, and so one can assert that if a > 0, then Eq. (16.24) holds also for x = 1. 

In particular, we can assert that for a > 0 


(1—77)* =1 fo, 


1! 2! 
—-1)---(@— 1 
pea. te-) . n+ Dima... (16.25) 
Nn. 
and this series converges to (1 — t2)% uniformly on [—1, 1]. 
Setting a = 5 and t? = 1 — x? in (16.25), for |x| < 1 we find 
3 2 2G =4) 2\2 
|x| =1 au x*)+ 7 (1 a) vee, (16.26) 


and the series of polynomials on the right-hand side converges to |x| uniformly on 
the closed interval [—1, 1]. Setting P, (x) := S,(x) — S,(O), where S;,(x) is the nth 
partial sum of the series, we find that for any prescribed tolerance ¢ > 0 there is a 
polynomial P(x) such that P(0) = 0 and 


max ||x|— P(x)| <e. (16.27) 
—l<x<l 

Let us now return to the general theory. 

We have shown that continuity of functions is preserved under uniform passage 
to the limit. The condition of uniformity in passage to the limit is, however, only 
a sufficient condition in order that the limit of continuous functions also be a con- 
tinuous function (see Examples 8 and 9 of Sect. 16.1). At the same time there is a 
specific situation in which the convergence of continuous functions to a continuous 
function guarantees that the convergence is uniform. 


Proposition 2 (Dini’s~ theorem) /f a sequence of continuous functions on a com- 
pact set converges monotonically to a continuous function, then the convergence is 
uniform. 


2U. Dini (1845-1918) — Italian mathematician best known for his work in the theory of functions. 


16.3. Functional Properties of a Limit Function 385 


Proof For definiteness suppose that f,, is a nondecreasing sequence converging 
to f. We fix an arbitrary « > 0, and for every point x of the compact set K we 
find an index n, such that 0 < f(x) — fn, (x) < e. Since the functions f and fy, 
are continuous on K, the inequality 0 < f(&) — fn, (€) < € holds in some neigh- 
borhood U(x) of x € K. From the covering of the compact set K by these neigh- 
borhoods one can extract a finite covering U(x1),..., U(x) and then fix the in- 
dex n(€) = max{n,,,..., Mx,}. Then for any n > n(e), by the fact that the sequence 
{fri n € N} is nondecreasing, we have 0 < f(&)— fn (€) < € at every pointé € K. 


Corollary 3 [f the terms of the series }~-_, an(x) are nonnegative functions ap : 
K — R that are continuous on a compact set K and the series converges to a 
continuous function on K, then it converges uniformly on K. 


Proof The partial sums s,(x) = )-;_, ax (x) of this series satisfy the hypotheses of 
Dini’s theorem. 


Example 3 We shall show that the sequence of functions f,(x) =n(1—x 1/n) tends 
to f(x) = Int as n — +00 uniformly on each closed interval [a, b] contained in 
the interval 0 < x < oo. 


Proof For fixed x > 0 the function x! = e’!"* is convex with respect to f, so that the 


0 
ratio vee (the slope of the chord) is nonincreasing as t — +0 and tends to Inx. 


Hence f,(x) 7 In+ for x > 0 as n > +00. By Dini’s theorem it now follows 


that the convergence of f,(x) to Int is uniform on each closed interval [a, b] C 
]0, +o0[. 


We note that the convergence is obviously not uniform on the interval 0 < x < 1, 
for example, since In+ is unbounded in that interval, while each of the functions 
FSn(x) is bounded (by a constant depending on 7). 


16.3.4 Integration and Passage to the Limit 


We shall show that if functions that are integrable over a closed interval converge 
uniformly on that interval, then the limit function is also integrable and its integral 
over that interval equals the limit of the integrals of the original functions. 


Theorem 3 Let {f;;t € T} be a family of functions f; : [a,b] — C defined on a 
closed interval a < x < b and depending on the parameter t € T, and let B be a 
base in T. If the functions of the family are integrable on [a,b] and f; = f on 
[a, b] over the base B, then the limit function f : [a,b] > C is also integrable on 
[a, b] and 


b b 
i) fls)dx =tim [ fi(x) dx. 
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Proof Let p = (P, €) bea partition P of the closed interval [a, b] with distinguished 
points € = {&,...,&,}. Consider the Riemann sums F,(p) = 77, fr (&i) Axi, t € 
T,and F(p) = a F (&) Ax;. Let us estimate the difference F'(p) — F;(p). Since 
fi = f on [a, b] over the base B, for every ¢ > 0 there exists an element B of B 
such that | f(x) — fi(x)| < boa at any t € B and any point x € [a, b]. Hence for 
t € B we have 


n 


|F(p) — Fi(p)| =| (FG) — AED) Ax] < Do| FG) — AEDAx <e, 


i=l i=l 


and this estimate holds not only for every t € B, but also for every partition p in the 
set P = {(P, &)} of partitions of the closed interval [a, b] with distinguished points. 
Thus F; — F on P over the base GB. Now, taking the traditional base A(P) > 0 
in P, we find by Theorem | that the following diagram is commutative: 


AGA = F(p) = F(p—) = DFG AN 


i=l B ra i=l 
eo 
A(P)>0 | a 3 | A(P)>0 
a 
b we b 


[ fiar=a : A= | fir(x) dx 


which proves Theorem 3. 


Corollary 4 [f the series \~-_, fn(x) consisting of integrable functions on a closed 
interval [a, b] C R converges uniformly on that closed interval, then its sum is also 
integrable on [a, b] and 


b/{& CO Ab 
[(Sae)e=y fle de 


n=l n=1°4 
Example 4 When we write sina in this example, we shall assume that this ratio 
equals 1 when x = 0. 

We have noted earlier that the function Si(x) = ie int dt is not an elementary 
function. Using the theorem just proved, we can nevertheless obtain a very simple 
representation of this function as a power series. 

To do this, we remark that 


Sint = (-1)” pon 
ain oer , (16.28) 


and the series on the right-hand side converges uniformly on every closed interval 
[—a,a] CR. The uniform convergence of the series follows from the Weierstrass 
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ley 2" 2n 


a 
Unt = oon for |t| < a, while the numerical series bead =0 Gnthi 


M-test, since ntl 


converges. 
By Corollary 4 we can now write 


(ee) 


x =| n 
Si(x) = [ (>: ne) dt = 
oe x —1)r iad _4)\ny2n+1 
“Wo Gat)! & (2n + 1)\(2n + 1) 


The series just obtained also turns out to converge uniformly on every closed 
interval of the real line, so that, for any closed interval [a,b] of variation of the 
argument x and any preassigned absolute error tolerance, one can choose a polyno- 
mial — a partial sum of this series — that makes it possible to compute Si(x) with less 
than the given error at every point of the closed interval [a, 5]. 


16.3.5 Differentiation and Passage to the Limit 


Theorem 4 Let { f;; t € T} be a family of functions f, : X — C defined on a con- 
vex bounded set X (in R, C, or any other normed space) and depending on the 
parameter t € T; let B be a base in T. If the functions of the family are differen- 
tiable on X, the family of derivatives { f/;t € T} converges uniformly on X to a 
function g : X — C, and the original family { f;; t € T} converges at even one point 
xo € X, then it converges uniformly on the entire set X to a differentiable function 
f:X—>C,and f'=¢. 


Proof We begin by showing that the family { f+; t € T} converges uniformly on the 
set X over the base B. We use the mean-value theorem in the following estimates: 


| f(x) — fir(x)| < 
<|(fi@) — fio®)) — (fi: Go) — fin 0))| + | fr, 0) — fir Xo)| < 
< sup Wi (&) — f;,(€)|lx — x01 + | fr, 0) — fin 00) | = AG, t1, 12). 


EE[x0,x] 


By hypothesis the family { f/; t € T} converges uniformly on X over the base B, 
and the quantity f;(xo) has a limit over the same base as a function of t, while 
|x — xq| is bounded for x € X. By the necessity part of the Cauchy criterion for 
uniform convergence of the family of functions f/ and the existence of the limit 
function f;(xo), for every ¢ > 0 there exists B in B such that A(x, ty, 2) < € for 
any f,, t2 € B and any x € X. But, by the estimates just written, this means that the 
family of functions { f;; t € T} satisfies the hypotheses of the Cauchy criterion and 
consequently converges on X over the base B to a function f : X > C. 
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Again using the mean-value theorem, we now obtain the following estimates: 
(fn @ +4) — fir) — fy Oh) — (fo +h) — fo(®) — fh@A)| = 


=|(f — Sn) @ +4) -— Fn — fn) @) — On — Sn) @A| < 
= jue [Gn ca fin) (& of: @h)||h| Sa |Fa = fin) (x) |IAl = 


= (_ sup [fe +h) — f+ 6M)| + [4,0 — fi] I 


These estimates, which are valid for x, x + h € X show, in view of the uniform 
convergence of the family {f/; t € T} on X, that the family {F;; t € T} of functions 


fi@ +h) — fi) — fon 
|h| 


F,(h) = 


which we shall consider with a fixed value of x € X, converges over the base B 
uniformly with respect to all values of h #0 such that x +he X. 

We remark that F;(h) + 0 as h > 0 since the function f; is differentiable at 
the point x € X; and since f; > f and f/ > 9 over the base B, we have F;(h) > 
F(h)= ee over the base B. 

Applying Theorem |, we can now write the commutative diagram 


x+h)— fi(x)—f/ (xh ‘ : ft(xth)— f (x)— h 
Si (x+h) fi) f/ Qn =: F,(h) — F(h):= ft(xth) ou g(x) 


B 2 
oe 
h-0 | a | h-0 
a 
il 


0 ——___; 0 
B 


The right-hand limiting passage as h — 0 shows that f is differentiable at x € X 
and f"(x) = g(x). 


Corollary 5 [f the series \--°., fn(x) of functions fn : X — C that are differen- 
tiable on a bounded convex subset X (contained in R, C, or any other normed 
vector space) converges at even one point x € X and the series ~~, f(x) con- 
verges uniformly on X, then pear Sfn(x) also converges uniformly on X, its sum is 
differentiable on X, and 


( » ft) m=) 6G). 
n=1 n=l 


This follows from Theorem 4 and the definitions of the sum and uniform conver- 
gence of a series, together with the linearity of the operation of differentiation. 
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Remark 4 The proofs of Theorems 3 and 4, like the theorems themselves and their 
corollaries, remain valid for functions f; : X — Y with values in any complete 
normed vector space Y. For example, Y may be R, C, R”, C”, Cla, b], and so 
on. The domain of definition X for the functions f; in Theorem 4 also may be any 
suitable subset of any normed vector space. In particular, X may be contained in R, 
C, R”, or C”. For real-valued functions of a real argument (under additional con- 
vergence requirements) the proofs of these theorems can be made even simpler (see 
Problem 11). 


As an illustration of the use of Theorems 2-4 we shall prove the following propo- 
sition, which is widely used in both theory and in specific computations. 


Proposition 3 Let K C C be the convergence disk for a power series Y-° 9 Cn(z — 
zo)”. If K contains more than just the point zo, then the sum of the series f(z) is 
differentiable inside K and 


f@o= Yo nen(z = 20)". (16.29) 


n=1 


Moreover, the function f(z): K — C can be integrated over any path y : 
[0, 1] > K, and if [0, 1] 5 t-> z(t) € K, z(0) = zo, and z(1) =z, then 


i F@de= J) @— eo)". (16.30) 


n 
n=0 
Remark 5 Here ii f@dz := i, f (z(t))z'(t) dt. In particular, if the equality 


f@= pee n(x — xo)” holds on an interval —R < x — xg < R of the real line R, 
then 


x oo dn ; 
i fat = YFG a +1, 


Proof Since limy-+o0 "W/nJen| = limn-soo */en], it follows from the Cauchy— 
Hadamard formula (Theorem 2 of Sect. 16.2.2 that the power series bye pen (Z — 
zo)"—! obtained by termwise differentiation of the power series > tale — 2a)". 
has the same convergence disk K as the original power series. But by Theorem 2 of 
Sect. 16.2.2 the series yy Np (Z— 29)" | converges uniformly in any closed disk 
Kg contained in the interior of K. Since the series sa Cn(Z — Z0)”" obviously con- 
verges at z = zg, Corollary 5 is applicable to it, which justifies the equality (16.29). 
Thus it has now been shown that a power series can be differentiated termwise. 

Let us now verify that it can also be integrated termwise. 

If y : [0, 1] + K is a smooth path in K, there exists a closed disk Kg such that 
y C K, and K, C K. On K,, the original power series converges uniformly, so that 
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in the equality 

lo) 

f (zt) = ¥en(2(#) — zo)" 

n=0 
the series of continuous functions on the right-hand side converges uniformly on 
the closed interval 0 < ¢ < 1 to the continuous function f(z(t)). Multiplying this 
equality by the function z’(t), which is continuous on the closed interval [0, 1], does 
not violate either the equality itself nor the uniform convergence of the series. Hence 
by Theorem 3 we obtain 


1 
[ fewzoa= ae Cn (z(t) — zo)" 2’ (t) dt. 
0 


n=0 


But, 


1 


1 
/ (<(t) — 2(0))"2/(r) dt = d(z(t) — 2()"*! = 
0 


n+1 


_ 1 _ n+1 1 = n+l 
= (<1) = 2(0)"*! = =a)", 


and we arrive at Eq. (16.30). 


Since it is obvious that cp = f (zo) in the expansion f(z) = }°7° 9 Cn (z — 20)”, 


applying Eq. (16.29) successively, we again obtain the relation c, = Leo) G0) , which 
shows that a power series is uniquely determined by its sum and is the Taylor series 
of the sum. 


Example 5 The Bessel function Jy(x),n € N, is a solution of Bessel’s* equation 


xy" +xy + (ae = n’)y =0. 


Let us attempt to solve this equation, for example, for n = 0, as a power series 
y= 8 cyx*. Applying formula (16.29) successively, after elementary transfor- 
mations, we arrive at the relation 


ot Dt * cK + CK—2)x a St, 


from which, by the uniqueness of the power series with a given sum, we find 


c, = 0, k?cet+ce_-2=0, k=2,3,.... 


3E.W. Bessel (1784-1846) — German astronomer. 
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From this it is easy to deduce that c2,_; = 0, k € N, and cz, = (—1)* ye: If 


we assume Jo(0) = 1, we arrive at the solution 
2k 


CO 
an k 
Jo(x) =1+ Yep (kN 222k 
k=1 
This series converges on the entire line R (and in the entire plane C), so that all the 
operations carried out above in order to find its specific form are now justified. 


Example 6 In Example 5 we sought a solution of an equation as a power series. But 
if a series is given, using formula (16.29), one can immediately check to see whether 
it is the solution of a given equation. Thus, by direct computation, one can verify 
that the function introduced by Gauss 


Here rn DR Dee amd). 5 


n=1 


(the hypergeometric series) is well-defined for |x| < 1 and satisfies the so-called 
hypergeometric equation 


x(x — ly” —[y - (@+ B-1)x]-y'+08-y=0. 


In conclusion we note that, in contrast to Theorems 2 and 3, the hypotheses of 
Theorem 4 require that the family of derivatives, rather than the original family, con- 
verge uniformly. We have already seen (Example 2 of Sect. 16.1) that the sequence 
of functions f,(x) = 1 sin n?x converges to the differentiable function f(x) =0 
uniformly, while the sequence of derivatives f(x) does not converge to f’(x). The 
point is that the derivative characterizes the rate of variation of the function, not the 
size of the values of the function. Even when the function changes by an amount 
that is small in absolute value, the derivative may formally change very strongly, as 
happens in the present case of small oscillations with large frequency. This is the 
circumstance that lies at the basis of Weierstrass’ example of a continuous nowhere- 
differentiable function, which he gave as the series f(x) = pea a” cos(b" x), 
which obviously converges uniformly on the entire line R if 0 < a < 1. Weierstrass 
showed that if the parameter b is chosen so as to satisfy the conditiona-b > 1+ an, 
then on the one hand f will be continuous, being the sum of a uniformly convergent 
series of continuous functions, while on the other hand, it will not have a derivative 
at any point x € R. The rigorous verification of this last assertion is rather taxing, 
so that those who wish to obtain a simpler example of a continuous function having 
no derivative may see Problem 5 in Sect. 5.1. 


16.3.6 Problems and Exercises 


1. Using power series, find a solution of the equation y’(x) — y(x) = 0 satisfying 
the conditions 
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a) y(0) =0, yd) = 1; 
b) yO) =1, yd) =0. 


2. Find the sum of the series )°°° | = a +D° 
3. a) Verify that the function defined by the series 


[ee 


7 (-1)k 7 2k-+n 
In@) = dX ki(k-+n)! (5) 


is a solution of Bessel’s equation of order n > 0 from Example 5. 
b) Verify that the hypergeometric series in Example 6 provides a solution of the 
hypergeometric equation. 


4. Obtain and justify the following expansions, which are suitable for computation, 
for the complete elliptic integrals of first and second kind with 0 <k < 1. 


(Qn —1)!! 
K(k k : 
aa i pa =3(1 +(e (2n)! ) ‘ 
(2n—1)"\? 2" 
m= f V1—k? sin? pdy = =( >( Oni ) ot) 


5. Find 
®) Dhorte; 
b) io r* coskg; 
c) )y_or* sinkg. 


n=1 


Show that the following relations hold for |r| < 1: 


ikp 1 
d) pare aie ig 1—r cos g— irsing? 
1l-r 
So er COSkp = b> ETI 
CO Uk: a r sing 
f) deka! sink = 1—2r cos g+r2" 


Verify that the following equations are true in the sense of Abel summation: 


g) el he eae neZs 
h) 324 sinkg = 5 cot $ ifgA2nmn, ne Z. 


6. After considering the product of the series 
(Qo +ai+:::)Gotbhit+--)=(Coteait+:::), 


where Cy = doby + ai bn—1 +++: + an—1b1 + abo, and using Proposition 1, show 
that if the series )°7° 9 dn, Dopp bn, and > 9 Cn converge respectively to A, B, 
and C, then A- B=C. 
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7. Let sy = 7 ae and of = tyr See The series is Cesdro* summable, 


more precisely (c, 1)-summable to A, if limy—+o. 0, = A. In that case we write 
paar ay, = A(c, 1). 


a) Verify that 1-1+1—1+---=3(c, D. 

b) Show that o, = 7, (1 — "ag. 

c) Verify that if }°7°., a, = A in the usual sense, then )°7° , ax = A(c, 1). 

d) The (c, 2)-sum of the series ae ax is the quantity limp— oo (1 +---+0y) 
if this limit exists. In this way one can define the (c, r)-sum of any order r. Show 
that if 7? ; ax = A(c,r), then °°, ax = A(c,r + 1). 

e) Prove that if baa 1 & = A(c, 1), then the series is also Abel summable to A. 


8. a) A “theorem of Tauberian type” is the collective description for a class of 
theorems that make it possible, by introducing various extra hypotheses, to judge 
the behavior of certain quantities from the behavior of certain of their means. An 
example of such a theorem involving Cesaro summation of series is the following 
proposition, which you may attempt to prove following Hardy.° 

If yr. an = A(c, 1) and ay = O(2), then the series °°, dn converges in the 
ordinary sense and to the same sum. 

b) Tauber’s” original theorem relates to Abel summation of series and consists 
of the following. 

Suppose the series pal anx" converges for 0 < x < 1 and lim,-,1-0 pana An X 
x" = A. If limy—+oo ntlat nay = 0, then the series bared Qn converges to A in 
the ordinary sense. 


9. It is useful to keep in mind that in relation to the limiting passage under the in- 
tegral sign there exist theorems that give much freer sufficient conditions for the 
possibility of such a passage than those made possible by Theorem 3. These theo- 
rems constitute one of the major achievements of the so-called Lebesgue integral. 
In the case when the function is Riemann integrable on a closed interval [a, b], 
that is, f € R[a, b], this function also belongs to the class L[a, b] of Lebesgue- 
integrable functions, and the values of the Riemann integral (R) ie f(x) dx of f 


and the Lebesgue integral (L) 1 7 Ff (x) dx are the same. 
In general the space L[a,b] is the completion of [a,b] (more precisely, 


R[a, b]) with respect to the integral metric), and the integral (L) f ‘s is the con- 


tinuation of the linear functional (R) i from Ra, b] to La, bd]. 
The definitive Lebesgue “dominated convergence” theorem asserts that if a se- 
quence {fn;n € N} of functions fn € Lla,b] is such that there exists a non- 


4B, Cesaro (1859-1906) — Italian mathematician who studied analysis and geometry. 

5G.H. Hardy (1877-1947) — British mathematician who worked mainly in number theory and 
theory of functions. 

®A. Tauber (b. 1866, year of death unknown) — Austrian mathematician who worked mainly in 
number theory and theory of functions. 
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negative function F € Lia, b] that majorizes the functions of the sequence, that 
is, | fn(x)| < F(x) almost everywhere on [a,b], then the convergence fy, > f 
at almost all points of the closed interval [a,b] implies that f € Lla,b] and 


limy+o0(L) fx) dx = (L) [? fx) (dx). 


a) Show by example that even if all the functions of the sequence { f,,; n € N} are 
bounded by the same constant M on the interval [a, b], the conditions f, € R[a, b], 
n &€N and f, — f pointwise on [a, b] still do not imply that f € R[a, b]. (See 
Example 5 of Sect. 16.1.) 

b) From what has been said about the relation between the integrals (R) f ‘4 and 
(L) i and Lebesgue’s theorem show that, under the hypotheses of part a), if it is 
known that f € ?[a, b], then (R) p Ff (x) dx = limy-+o0(R) i Jn(x) dx. This is a 
significant strengthening of Theorem 3. 

c) In the context of the Riemann integral one can also state the following version 
of Lebesgue’s monotone convergence theorem. 

If the sequence { fn;n € N} of functions fy, € Ra, b] converges to zero mono- 
tonically, that is,O< fna1< fn and fy > 0 as n— o for every x € [a, b], then 
(R) f? fn(x)dx > 0. 

Prove this assertion, using where needed the following useful observation. 

d) Let f € R[a, b], | f| < M, and i f(x) dx >a > 0. Then the set EF = {x € 
[0, 1] | f(x) => a@/2} contains a finite number of such intervals the sum of whose 
lengths (/) is at least a/(4M). 

Prove this, using, for example, the intervals of a partition P of the closed in- 
terval [0, 1] for which the lower Darboux sum s(/f, P) satisfies the relation 0 < 


Jo f(x) dx —s(f, P) <a/4. 


10. a) Show by the examples of Sect. 16.1, that it is not always possible to extract 
a subsequence that converges uniformly on a closed interval from a sequence of 
functions that converge pointwise on the interval. 

b) It is much more difficult to verify directly that it is impossible to extract a 
subsequence of the sequence of functions { f,;n € N}, where fn(x) = sinnx, that 
converges at every point of [0, 27]. Prove that this is nevertheless the case. (Use 
the result of Problem 9b) and the circumstance that Vi (sinngx — sin neyix)? dx = 
2m #0 for ny < ng+1.) 

c) Let { fn; € N} be a uniformly bounded sequence of functions f, € 7F[a, b]. 
Let 


F=f AO G2ree). 


Show that one can extract a subsequence of the sequence {F,;n € N} that con- 
verges uniformly on the closed interval [a, b]. 


11. a) Show that if f, fp ¢ R({a, b], R) and f, = f on [a, b] as n > on, then for 
every € > 0 there exists an integer N € N such that 
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b 
i G=fIOG| 20 


for everyn > N. 
b) Let fn € C"({a, b],R), n € N. Using the formula f,(x) = fn(xo) + 
i f,(t) dt, show that if f/ = gy on [a,b] and there exists a point xo € [a, b] 
for which the sequence { f;,(x0); 2 € N} converges, then the sequence of functions 
{ fn; n € N} converges uniformly on [a, b] to some function f € C)({a, b], R) and 
no f=. 


16.4 *Compact and Dense Subsets of the Space of Continuous 
Functions 


The present section is devoted to more specialized questions, involving the space of 
continuous functions, which is ubiquitous in analysis. All these questions, like the 
metric of the space of continuous functions’ itself, are closely connected with the 
concept of uniform convergence. 


16.4.1 The Arzela—Ascoli Theorem 


Definition 1 A family * of functions f : X — Y defined on a set X and assuming 
values in a metric space Y is uniformly bounded on X if the set of values V = {y € 
Y |afeF Ax € X (y= f(x))} of the functions in the family is bounded in Y. 


For numerical functions or for functions f : X —> R", this simply means that 
there exists a constant M € R such that | f(x)| < M for all x € X and all functions 
fees. 


Definition 1’ If the set V C Y of values of the functions of the family F is totally 
bounded (that is, for every ¢ > 0 there is a finite e-grid for V in Y), the family F is 
totally bounded. 

For spaces Y in which the concept of boundedness and total boundedness are 
the same (for example, for R, C, R”, and C” and in general in the case of a locally 
compact space Y), the concepts of uniform boundedness and total boundedness are 
the same. 


Definition 2 Let X and Y be metric spaces. A family F of functions f : X > 
Y is equicontinuous on X if for every ¢ > 0 there exists 5 > 0 such that 


TIf you have not completely mastered the general concepts of Chap. 9, you may assume without 
any loss of content in the following that the functions discussed always map R into R or C into C, 
or R” into R”. 
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dy (f (x1), f(%2)) < € for any function f in the family and any x;,x2 € X such 
that dy (x1, x2) <6. 


Example I The family of functions {x”; n € N} is not equicontinuous on [0, 1], but 
it is equicontinuous on any closed interval of the form [0, g] where 0 <q < 1. 


Example 2 The family of functions {sinnx;n € N} is not equicontinuous on any 
nondegenerate closed interval [a, b] c R. 


Example 3 If the family {fy : [a,b] ~ R;a@ € A} of differentiable functions fy 
is such that the family { f/; @ € A} of their derivatives is uniformly bounded by a 
constant, then | fy (x2) — fa (%1)| < M|x2 —x1|, as follows from the mean-value the- 
orem, and hence the original family is equicontinuous on the closed interval [a, b]. 


The connection of these concepts with uniform convergence of continuous func- 
tions is shown by the following lemma. 


Lemma 1 Let K and Y be metric spaces, with K compact. A necessary condition 
for the sequence { fy,;n € N} of continuous functions fy, :K — Y to converge uni- 
formly on K is that the family { fn; n € N} be totally bounded and equicontinuous. 


Proof Let f, = f on K. By Theorem 2 of Sect. 16.3, we conclude that f € 
C(K, Y). It follows from the uniform continuity of f on the compact set K that for 
every € > 0 there exists 5 > 0 such that (dx (x1, x2) < 6 => dy (f(%1), f(x2)) <) 
for all x},x2 € K. Given the same ¢ > O we can find an index N € N such 
that dy(f(x), fu(x)) < e for all n > N and all x € X. Combining these in- 
equalities and using the triangle inequality, we find that dx (x1, x2) < 6 implies 
dy (fn(x1), fn(x2)) < 3e for every n > N and x1,x2 € K. Hence the family 
{fn3n > N} is equicontinuous. Adjoining to this family the equicontinuous family 
{fi,..-, fw} consisting of a finite number of functions continuous on the compact 
set K, we obtain an equicontinuous family { f,; 1 € N}. 

Total boundedness of F follows from the inequality dy (f(x), fn(x)) < €, which 
holds for x €¢ K and n > N, and the fact that f(K) and Us Ffn(K) are compact 
sets in Y and hence totally bounded in Y. 


Actually the following general result is true. 


Theorem 1 (Arzela—Ascoli) Let F be a family of functions f : K — Y defined on 
a compact metric space K with values in a complete metric space Y . 

A necessary and sufficient condition for every sequence { fy € F;n € N} to con- 
tain a uniformly convergent subsequence is that the family F be totally bounded 
and equicontinuous. 


Proof Necessity. If F were not a totally bounded family, one could obviously con- 
struct a sequence { f,; 7 € N} of functions f,, € F that would not be totally bounded 
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and from which (see the lemma) one could not extract a uniformly convergence 
subsequence. 


If F is not equicontinuous, there exist a number €9 > 0, a sequence of functions 
{fn € F; n € N}, and a sequence {(x/,, x/’); n € N} of pairs (x), x/’) of points x/, and 
x! that converge to a point x9 € K as n > ov, but dy(fn(x},), fulay,)) = €0 > 0. 
Then one could not extract a uniformly convergent subsequence from the sequence 
{ fn; n € N}: in fact, by Lemma 1, the functions of such a subsequence must form an 


equicontinuous family. 


Sufficiency. We shall assume that the compact set K is infinite, since the assertion is 
trivial otherwise. We fix a countable dense subset E' in K —a sequence {x, € K;n€ 
N}. Such a set E is easy to obtain by taking, for example, the union of the points of 
finite e-grids in K obtained fore = 1,1/2,...,1/n,.... 


Let { fn; n € N} be an arbitrary sequence of functions of F. 

The sequence { f,,(x;); 1 € N} of values of these functions at the point x, is totally 
bounded in Y by hypothesis. Since Y is a complete space, it is possible to extract 
from it a convergent subsequence { fy, (%1); k € N}. The functions of this sequence, 
as will be seen, can be conveniently denoted Es n €N. The superscript 1 shows 
that this is the sequence constructed for the point x1. 

From this subsequence we extract a further subsequence { ie k € N} which we 
denote { sie n € N} such that the sequence { : 

Continuing this process, we obtain a series iT neéeN}, k=1,2,... of se- 
quences. If we now take the “diagonal” sequence {g, = f,’;n € N}, it will converge 
at every point of the dense set E C K, as one can easily see. 

We shall show that the sequence {g,;n € N} converges at every point of K 
and that the convergence is uniform on K. To do this, we fix ¢ > 0 and choose 
56 > 0 in accordance with Definition 2 of equicontinuity of the family F. Let 
E, = {&1,...,&} be a finite subset of E forming a 6-grid on K. Since the se- 
quences {g,(&);n € N}, i = 1,2,...,k, all converge, there exists N such that 
dy (gm (&i), 8n(i)) < € fori =1,2,...,k andallm,n> WN. 

For each point x € K there exists ; € E such that dx (x, §;) < 5. By the equicon- 
tinuity of the family F, it now follows that dy (gn (x), gn(&j)) < € for every n EN. 
Using these inequalities, we now find that 


(x2); k € N} converges. 


dy (Sm (x), 8n (x)) <dy (gn (x), Sn (&;)) +dy (8m (€j). 8n (&;)) os 
+ dy(8m(x), &m(E/)) <etete=3e 
forallm,n>WN. 


But x was an arbitrary point of the compact set K,, so that, by the Cauchy criterion 
the sequence {g,; 7 € N} indeed converges uniformly on K. 
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16.4.2. The Metric Space C(K, Y) 


One of the most natural metrics on the set C(K, Y) of functions f : K — Y that are 
continuous on a compact set K and assume values in a complete metric space Y is 
the following metric of uniform convergence. 


d(f.g)= max dy (f(x), g(x)), 


where f, g € C(K, Y), and the maximum exists, since K is compact. The name 
metric comes from the obvious fact that d( fn, f) ~ 0 fr = fon K. 

Taking account of this last relation, by Theorem 2 of Sect. 16.3 and the Cauchy 
criterion for uniform convergence we can conclude that the metric space C(K, Y) 
with the metric of uniform convergence is complete. 

We recall that a precompact subset of a metric space is a subset such that from 
every sequence of its points one can extract a Cauchy (fundamental) subsequence. 
If the original metric space is complete, such a sequence will even be convergent. 

The Arzela—Ascoli theorem gives a description of the precompact subsets of the 
metric space C(K, Y). 

The important theorem we are about to prove gives a description of a large va- 
riety of dense subsets of the space C(K, Y). The natural interest of such subsets 
comes from the fact that one can approximate any continuous function f : K — Y 
uniformly with absolute error as small as desired by functions from these subsets. 


Example 4 The classical result of Weierstrass, to which we shall often return, and 
which is generalized by Stone’s theorem below, is the following. 


Theorem 2 (Weierstrass) If f € C([a, b], C), there exists a sequence { Py; n € N} of 
polynomials Py, : [a,b] > C such that P, = f on [a,b]. Here, if f € C((a, b], R), 
the polynomials can also be chosen from C ({a, b], R). 


In geometric language this means, for example, that the polynomials with real 
coefficients form an everywhere dense subset of C({a, b], R). 


Example 5 Although Theorem 2 still requires a nontrivial proof (given below), one 
can at least conclude from the uniform continuity of any function f € C({a, b], R) 
that the piecewise-linear continuous real-valued functions on the interval [a, b] are 
a dense subset of C([a, b], R). 


Remark 1 We note that if E; is everywhere dense in Ez and E> is everywhere dense 
in £3, then Ej is obviously everywhere dense in £3. 

This means, for example, that to prove Theorem 2 it suffices to show that a piece- 
wise linear function can be approximated arbitrarily closely by a polynomial on the 
given interval. 
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16.4.3 Stone’s Theorem 


Before proving the general theorem of Stone, we first give the following proof of 
Theorem 2 (Weierstrass’ theorem) for the case of real-valued functions, which is 
useful in helping to appreciate what is to follow. 


Proof We first remark that if f, g € C([a, b], R), a € R, and the functions f and g 
admit a uniform approximation (with arbitrary accuracy) by polynomials, then the 
continuous functions f + g, f -g,anda/f also admit such an approximation. 

On the closed interval [—1, 1], as was shown in Example 2 of Sect. 16.3, the 
function |x| admits a uniform approximation by polynomials P,(x) = )-7_y agx*. 
Hence, the corresponding sequence of polynomials M - P,(x/M) gives a uniform 
approximation to |x| on the closed interval |x| < M. 

If f ¢ C({a, b], R) and M = max|f(x)|, it follows from the inequality ||y| — 
pe cky*| < & for |y| < M that || f@)| — iL ce f*@)| < ¢ fora <x <b. 
Hence if f admits a uniform approximation by polynomials on [a,b], then 
ph a K and | f| also admit such an approximation. 

Finally, if f and g admit a uniform approximation by polynomials on the closed 
interval [a, b], then by what has been said, the functions max{ /, g} = 5(( ft+at+ 
| f — g|) and min{ f, g} = s((f + g) —|f — g|) also admit such an approximation. 


Leta <i <& <b, f(x) =0, gen) = EH, AG) = 1, Say = 
max{ f, ge,e,}, and Fz,<, = min{h, ®¢,¢,}. Linear combinations of functions of the 
form F:,¢, obviously generate the entire set of continuous piecewise-linear func- 
tions on the closed interval [a, b], from which, by Example 5, Weierstrass’ theorem 


follows. 


Before stating Stone’s theorem, we define some new concepts. 


Definition 3 A set A of real- (or complex-)valued functions on a set X is called a 
real (or complex) algebra of functions on X if 


(f+a)eA, (f-g)eA, (@fyeA 


when f,g € AandaeR (orae€C). 


Example 6 Let X C C. The polynomials P(z) = co+c1z+c2z7 +--+: +enz", n EN, 
obviously form a complex algebra of functions on X. 

If we take X = [a, b] CR, and take only polynomials with real coefficients, we 
obtain a real algebra of functions on the closed interval [a, b]. 


Example 7 The linear combinations of functions e”*, n = 0, 1,2,... with coeffi- 
cients in R or C also form a (real or complex respectively) algebra on any closed 
interval [a,b] CR. 

The same can be said of linear combinations of the functions {e!”*; n € Z}. 
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Definition 4 We shall say that a set S of functions on X separates points on X if 
for every pair of distinct points x1, x2 € X there exists a function f € S such that 


f (x1) F f (x2). 


Example 8 The set of functions {e”; n € N}, and even each individual function in 
the set, separates points on R. 

At the same time, the 27-periodic functions {e!”*; n € Z} separates points of a 
closed interval if its length is less than 27 and obviously does not separate the points 
of an interval of length greater than or equal to 27. 


Example 9 The real polynomials together form a set of functions that separates rates 
the points of every closed interval [a, b], since the polynomial P(x) = x does that 
all by itself. What has just been said can be repeated for a set X C C and the set of 
complex polynomials on X. As a single separating function, one can take P(z) = z. 


Definition 5 The family F of functions f : X — C does not vanish on X (is nonde- 
generate) if for every point x9 € X there is a function fp € F such that fo(xo9) 4 0. 


Example 10 The family F = {1,x,x?,...} does not vanish on the closed interval 
[0, 1], but all the functions of the family Fo = {x, Kris .} vanish at x = 0. 


Lemma 2 /f an algebra A of real (resp. complex) functions on X separates the 
points of X and does not vanish on X, then for any two distinct points x1, x2 € X 
and any real (resp. complex) numbers c,, cz there is a function f in A such that 


f (x1) =c1 and f (x2) =c2. 


Proof It obviously suffices to prove the lemma when c; = 0, cz = | and when 
cp=l,a=0. 

By the symmetry of the hypotheses on x; and x2, we consider only the case 
Cq= 1, 2= 0. 

We begin by remarking that A contains a special function s separating the points 
x1 and x2 that, in addition to the condition s (x1) ~ 5(x2), also satisfies the condition 
S(x1) £0. 

Let g,h EA, g(x) € g(x2), g(x) = 0,7 and h(x;) # 0. There is obviously a 
number A € R\O such that A(h(x1) — h(x2)) # g(x2). The function s = g + AA then 
has the required properties. 


. a 2 a — d a 
Now, setting f(x) = ees Te 


satisfying f (x1) = 1 and f(x2) =0. 


we obtain a function f in the algebra A 


Theorem 3 (Stone®) Let A be an algebra of continuous real-valued functions de- 
fined on a compact set K. If A separates the points of K and does not vanish on K, 
then A is an everywhere-dense subspace of C(K, R). 


8MLH. Stone (1903-1989) — American mathematician who worked mainly in topology and func- 
tional analysis. 
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Proof Let A be the closure of the set A C C(K,R) in C(K, R), that is, A consists 
of the continuous functions f € C(K, R) that can be approximated uniformly with 
arbitrary precision by functions of A. The theorem asserts that A = C(K, R). 

Repeating the reasoning in the proof of Weierstrass’ theorem, we note that if 
f.g €A anda €R, then the functions f +g, f-g,af,|f|, max{f, g}, min{/, g} 
also belong to A. By induction we can verify that in general if f1, fo,..., fn € A, 
then max{ fi, f2,..-, fr} and min{/|, fo,..., fn} also lie in A. 

We now show that for every function f € C(K, R), every point x € K, and every 
number ¢€ > 0, there exists a function g, € ‘A such that &x(x) = f(x) and gy (t) > 
f@)—« foreveryte K. 

To verify this, for each point y € K we use Lemma 2 to choose a function hy € A 
such that hy(x) = f(x) and hy(y) = f(y). By the continuity of f and hy on K, 
there exists an open neighborhood U, of y such that h,(t) > f(t) — € for every 
t € Uy. From the covering of the compact set K by the open sets Uy we select a finite 
covering {Uy,, Uy,,..., Uy,}. Then the function gy = max{hy,,hy,,...,hy,}€A 
will be the desired function. 

Now taking such a function g, for each point x € K, we remark that by the 
continuity of gy and f, there exists an open neighborhood V; of x € K such that 
gx(t) < f(t) +e for every t € V,. Since K is compact, there exists a finite cover- 
ing {Vy,, Vi.,---» Vx,, } by such neighborhoods. The function g = min{gy,,-.., 2x} 
belongs to A and by construction, satisfies both inequalities 


f-e<sO<fOt+e 


at every point. 
But the number ¢ > 0 was arbitrary, so that any function f € C(K,R) can be 
uniformly approximated on K by functions in A. 


16.4.4 Problems and Exercises 


1. A family F of functions f : X — Y defined on the metric space X and assuming 
values in the metric space Y is equicontinuous at xo € X if for every ¢ > O there 
exists 6 > 0 such that dy (x, x9) < 6 implies dy (f(x), f(xo)) < ¢ for every f € F. 


a) Show that if a family F of functions f : X — Y is equicontinuous at xo € X, 
then every function f € F is continuous at xo, although the converse is not true. 

b) Prove that if the family F of functions f : K — Y is equicontinuous at each 
point of the compact set K, then it is equicontinuous on K in the sense of Defini- 
tion 2. 

c) Show that if a metric space X is not compact, then equicontinuity of a family 
F of functions f : X — Y at each point x € X does not imply equicontinuity of F 
on X. 

For this reason, if the family F is equicontinuous on a set X in the sense of 
Definition 2, we often call it uniformly equicontinuous on the set. Thus, the relation 
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between equicontinuity at a point and uniform equicontinuity of a family of func- 
tions on a set X is the same as that between continuity and uniform continuity of an 
individual function f : X — Y on the set X. 

d) Let w(f; E) be the oscillation of the function f : X — Y onthe set E Cc X, 
and B(x, 4) the ball of radius 6 with center at x € X. What concepts are defined by 
the following formulas? 


Ve >0355>0Vf €F a(f; B(x, d)) <e, 
Ve >055>0Vf eF Vx €X o(f; B(x, 4)) <e. 


e) Show by example that the Arzela—Ascoli theorem is in general not true if 
K is not compact: construct a uniformly bounded and equicontinuous sequence 
{ fn; n € N} of functions f, (x) = g(x +n) from which it is not possible to extract a 
subsequence that converges uniformly on R. 

f) Using the Arzela—Ascoli theorem, solve Problem 10c) from Sect. 16.3. 


2. a) Explain in detail why every continuous piecewise-linear function on a closed 
interval [a, b] can be represented as a linear combination of functions of the form 
F:,¢, shown in the proof of Weierstrass’ theorem. 

b) Prove Weierstrass’ theorem for complex-valued functions f : [a,b] > C. 

c) The quantity M, = [ f (x)x" dx is often called the nth moment of the func- 
tion f : [a,b] > C on the closed interval [a, b]. Show that if f € C({a, b], C) and 
M,, = 0 for alln EN, then f(x) =0 on [a, bd]. 


3. a) Show that the algebra generated by the pair of functions {1, x7} is dense in 
the set of all even functions that are continuous on [—1, 1]. 

b) Solve the preceding problem for the algebra generated by the single function 
{x} and the set of odd functions that are continuous on [—1, 1]. 

c) Is it possible to approximate every function f € C([0, z], C) uniformly with 
arbitrary precision by functions in the algebra generated by the pair of functions 
{1, e'*}? 

d) Answer the preceding question in the case of f € C([—z, 1], C). 

e) Show that the answer to the preceding question is positive if and only if 
f(—x) = f(@). 

f) Can every function f € C([a,b],C) be uniformly approximated by linear 


combinations of the functions {1,cosx,sinx,...,cosnx,sinnx,...} if [a,b] C 
]-z,2[? 

g) Can any even function f € C((—z, 2], C) be uniformly approximated by 
functions of the system {1, cosx,...,cosnx,...}? 


h) Let [a, b] be an arbitrary closed interval on the real line R. Show that the 
algebra generated on [a, b] by any nonvanishing strictly monotonic function g(x) 
(for example, e*) is dense in C([a, b], R). 

i) For which location of the closed interval [a, b] C R is the algebra generated 
by g(x) =x dense in C([a, b], R)? 


4. a) A complex algebra of functions A is self-adjoint if it follows from f € A 
that f € A, where f(x) is the value conjugate to f(x). Show that if a complex 
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algebra A is nondegenerate on X and separates the points of X, then, given that A 
is self-adjoint, one can assert that the subalgebra Ap of real-valued functions in A 
is also nondegenerate on X and also separates points on X. 

b) Prove the following complex version of Stone’s theorem. 

If a complex algebra A of functions f : X — C is nondegenerate on X and 
separates the points of X, then, given that it is self-adjoint, one can assert that it is 
dense in C(X,C). 

c) Let X = {z€C| |z| = 1} be the unit circle and A the algebra on X generated 
by the function e’”, where ¢ is the polar angle of the point z € C. This algebra is 
nondegenerate on X and separates the points of X, but is not self-adjoint. 


Prove that the equalities ‘fe ™ f(el?)ei"? dp = 0, n € N, must hold for any func- 
tion f : X —> C that admits uniform approximation by elements of A. Using this 
fact, verify that the restriction of the function f(z) = Z to the circle X is a continu- 
ous function on X that does not belong to the closure of the algebra A. 


Chapter 17 
Integrals Depending on a Parameter 


In this chapter the general theorems on families of functions depending on a param- 
eter will be applied to the type of family most frequently encountered in analysis — 
integrals depending on a parameter. 


17.1 Proper Integrals Depending on a Parameter 
17.1.1 The Concept of an Integral Depending on a Parameter 


An integral depending on a parameter is a function of the form 
F(t)= f(x, t) dx, (17.1) 
Er 


where ¢ plays the role of a parameter ranging over a set T, and to each value t € T 
there corresponds a set E; and a function g;(x) = f(x, t) that is integrable over E;, 
in the proper or improper sense. 

The nature of the set T may be quite varied, but of course the most important 
cases occur when T is a subset of R, C, R”, or C”. 

If the integral (17.1) is a proper integral for each value of the parameter ¢ € T, 
we say that the function F in (17.1) is a proper integral depending on a parameter. 

But if the integral in (17.1) exists only as an improper integral for some or all 
of the values of t € T, we usually call F an improper integral depending on a 
parameter. 

But these are of course merely terminological conventions. 

When x € R”, E; C R”, and m > 1, we say that we are dealing with a multiple 
(double, triple, and so forth) integral (17.1) depending on a parameter. 

We shall concentrate, however, on the one-dimensional case, which forms the 
foundation for all generalizations. Moreover, for the sake of simplicity, we shall 
first take E; to be intervals of the real line R independent of the parameter, and we 
shall assume that the integral (17.1) over these intervals exists as a proper integral. 
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17.1.2. Continuity of an Integral Depending on a Parameter 


Proposition 1 Let P = {(x, y)€ R2 la<x<bAc<y<d} bea rectangle in the 
plane R?. If the function f : P — R is continuous, that is, if f € C(P,R), then the 
function 


b 
F(y) = f(x, y) dx (17.2) 


is continuous at every point y € [c, d]. 


Proof It follows from the uniform continuity of the function f on the compact set P 
that gy (x) = f(x, y) 3 F(X, yo) =: Pyo (x) on [a, b] as y > yo, for y, yo € [c, a]. 
For each y € [c, d] the function g)(x) = f(x, y) is continuous with respect to x on 
the closed interval [a, b] and hence integrable over that interval. By the theorem on 
passage to the limit under an integral sign we can now assert that 


b b 
Foo)= f fee.so)de= tim fo, yyax= lim FO), 


Remark I As can be seen from this proof, Proposition | on the continuity of the 
function (17.2) remains valid if we take any compact set K as the set of values of 
the parameter y, assuming, of course, that f €e CU x K,R), where J] ={x ER| 
a<x <b}. 


Hence, in particular, one can conclude that if f €¢ C(J x D,R), where D is 
an open set in R”, then F € C(D,R), since every point yo € D has a compact 
neighborhood K C D, and the restriction of f to J x K is a continuous function on 
the compact set J x K. 

We have stated Proposition | for real-valued functions, but of course it and its 
proof remain valid for vector-valued functions, for example, for functions assuming 
values in C, R”, or C”. 


Example I In the proof of Morse’s lemma (see Sect. 8.6, Part 1) we mentioned the 
following proposition, called Hadamard’s lemma. 


If a function f belongs to the class C“)(U,R) in a neighborhood U of the point 
xo, then in some neighborhood of xo it can be represented in the form 


f(x) = fX0) + P(X) — xo), (17.3) 


where @ is a continuous function and ~(xo) = f' (xo). 
Equality (17.3) follows easily from the Newton—Leibniz formula 


1 
Fro +h) = foo) = f f'(xo + th) dt -h (17.4) 
0 
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and Proposition | applied to the function F (i) = i f' (xo +th) dt. All that remains 
is to make the substitution h = x — xo and set p(x) = F(x — xo). 

It is useful to remark that Eq. (17.4) holds for xo, A € R”, where n is not restricted 
to the value 1. Writing out the symbol f’ in more detail, and for simplicity setting 
xg = 0, one can write, instead of (17.4) 


Axi 


n 1 
0 ; 
fl ue)-£0,...9= > [ Ctx}, ...,tx") dt x4, 
i=l 0 
and then one should set 


g(x)x => gi(x)x! 


i=l 


in Eq. (17.3), where g; (x) = i, JF (tx) dt. 


17.1.3 Differentiation of an Integral Depending on a Parameter 


Proposition 2 [f the function f : P — Ris continuous and has a continuous partial 
derivative with respect to y on the rectangle P = {(x, y) € R2 |la<x<bAc< 
y <d}, then the integral (17.2) belongs to C\) ([c, d], R), and 


ba 
ros f sete yd. (17.5) 


Formula (17.5) for differentiating the proper integral (17.2) with respect to a 
parameter is frequently called Leibniz’ formula or Leibniz’ rule. 


Proof We shall verify directly that if yo € [c,d], then F’(yo) can be computed by 
formula (17.5): 


bg 
Foot F(y0) (/ (x, yu) ax) = 


= = 


b of 
i (Foy - fF, yo) — 7x. yooh) dx 
b 
={ 


b 
0 C) 
=| sup Beene cco Ggi) 
a 0<6é<1 dy dy 


dx < 


0 
f(x, yo +h) — f (x, yo) — a(x, 30)h 


dx|h| = p(yo, h) - |h]. 


By hypothesis ae € C(P, R), so that (x, yx a(x, yo) on the closed interval 


a<x<bas y— yo, from which it follows that @(yo, h) > 0 ash > 0. 
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Remark 2 The continuity of the original function f is used in the proof only as a 
sufficient condition for the existence of all the integrals that appear in the proof. 


Remark 3 The proof just given and the form of the mean-value theorem used in it 
show that Proposition 2 remains valid if the closed interval [c, d] is replaced by any 
convex compact set in any normed vector space. Here one may obviously assume as 
well that f takes values in some complete normed vector space. 

In particular — and this is sometimes very useful — formula (17.5) is also ap- 
plicable to complex-valued functions F of a complex variable and to functions 
F(y) = F(y!,..., y”) of a vector parameter y = (y!,..., y7) EC”. 

In this case gy can of course be written coordinatewise as (4, Saco in) 
then (17.5) yields the corresponding partial derivatives: 


of the function F’. 


Example 2 Let us verify that the function u(x) = rs cos(ng — x sing) d¢ satisfies 
Bessel’s equation x7u" + xu! + (x? —n?)u=0. 

Indeed, after carrying out the differentiation with formula (17.5) and making 
simple transformations we find 


a bs 
—x? i sin? gy cos(ng — x sing) dg + x / sing sin(ng — x sing) dg + 
0 0 
1s 
+ (x? — n’) i cos(ng — x sing) dg = 
0 


a 
—_ / ((x? sin? gp +n? — x) cos(ng — x sing) — 
0 
—x sing sin(ng — x sin 9)) dg = 


=—(n+x cos @) sin(ng — xsing)|5 =0. 


Example 3 The complete elliptic integrals 
wd. m/2 dy 
E(e) = i Heated, Xe= : —_* = (96 
0 0 1—k?sin* g 


as functions of the parameter k, 0 < k < 1, called the modulus of the corresponding 
elliptic integral, are connected by the relations 


dE E-K dK OE K 
dk kk’ dk k(1—k2)— ok 
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Let us verify, for example, the first of these. By formula (17.5) 
dE 
dk 


1 m/2 1 m/2 = 
=; (1- sin? 9)! ap — > f (1-Ksin?g) ' dp = 
0 0 


m/2 
-{ ksin?g-(1—K sin? g) | dy = 
0 


E-K 
= 


Example 4 Formulas (17.5) sometimes make it possible even to compute the inte- 
gral. Let 


m/2 
Fa)= | In(a? — sin? y)dp (a> 1). 
0 


According to formula (17.5) 


m/2 2a d 
F'(a) = / a am = Iv 
0 a2—sing a2—1 


from which we find F(a) = m In(a + Va? — 1) +c. 

The constant c is also easy to find, if we note that, on the one hand F(a) = 
mz lIna+z1In2+c+o(1) as a — +00, and on the other hand, from the definition of 
F (qa), taking account of the equality In(a? — sin? yg) =2Ina+o(1) aaa—> +o, 
we have F(a) = z Ina + o(1). Hence zIn2 + c = 0 and so F(a) = m In5(a + 


a? — 1). 
Proposition 2 can be strengthened slightly. 


Proposition 2’ Suppose the function f : P — R is continuous and has a continuous 
partial derivative ar on the rectangle P = {(x, y) € R?2 la<x<bAc<y<d}; 
further suppose a(y) and B(y) are continuously differentiable functions on [c, d] 


whose values lie in [a, b] for every y € [c, d]. Then the integral 


Biy) 

F(y)= i f(x, y) dx (17.7) 
a(y) 

is defined for every y € [c, d] and belongs to C\ ([c, d], R), and the following for- 

mula holds: 

Bty) 


Dee ae (17.8) 


F'(y) = f (BQ). 9) -B'Q) — F(a). ¥) -@"() +f a 


a(y) 


Proof Yn accordance with the rule for differentiating an integral with respect to the 
limits of integration, taking account of formula (17.5), we can say that if a, B € 
[a, b] and y € [c, d], then the function 


B 
(a, B, y= | fe, yde 
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has the following partial derivatives: 


a® a® a® of 

= =f(By), — =-f@,y), a te d 
aby. Feaf@y = fz (x, y) de. 
Taking account of Proposition |, we conclude that all the partial derivatives of ® 
are continuous in its domain of definition. Hence @ is continuously differentiable. 
Formula (17.8) now follows from the chain rule for differentiation of the composite 


function F(y) = ®(a(y), B(y), y). 


Example 5 Let 


EQ) =o af (x —1)""! fede, 
where n € N and f is a function that is continuous on the interval of integration. Let 
us verify that Fy(x) = f(x). 

For n = | we have F) (x) = tn f(t) dt and Fi(x) = f(x). 

By formula (17.8) we find for n > 1 that 


F,@)= Fy Te fQ+G af (x — 1)" 7 f@)dt = Fy_1(@). 


We now conclude by induction that indeed FO (x) = f(x) for everyn EN. 


17.1.4 Integration of an Integral Depending on a Parameter 


Proposition 3 [f the function f : P — R is continuous in the rectangle P = 
{(x,y) € R?2 |a<x<bAc<y<d}, then the integral (17.2) is integrable over 
the closed interval [c, d] and the following equality holds: 


d b b d 
aC fly)dr) ay= f (/ Fes. y)dy) a (17.9) 


Proof From the point of view of multiple integrals, Eq. (17.9) is an elementary 
version of Fubini’s theorem. However, we shall give a proof of (17.9) that justifies 
it independently of Fubini’s theorem. 

Consider the functions 


u b b u 
ow =| (/ f(r y)dr) dy, w= f (/ fer y)dy) a 


Since f € C(P,R), by Proposition 1 and the continuous dependence of the 
integral on the upper limit of integration, we conclude that g and wy belong to 
C({c, d], R). Then, by the continuity of the function (17.2), we find that g’(u) = 
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J? f(x, w dx, and finally by formula (17.5) that y/(u) = [? f(x,u)dx for wu € 
[c,d]. Thus g’(u) = W'(u), and hence g(u) = w(u) + C on [c,d]. But since 
g(c) = w(c) = 0, we have y(u) = w(u) on [c, d], from which relation (17.9) fol- 
lows for u = d. 


17.1.5 Problems and Exercises 


1. a) Explain why the function Fy) in (17.2) has the limit fe 4 g(x) dx if the family 
of functions g(x) = f(x, y) depending on the parameter y € Y and integrable 
over the closed interval a < x < b converges uniformly on that closed interval to a 
function g(x) over some base G& in Y (for example, the base y > yo). 

b) Prove that if E is a measurable set in R” and the function f: E x J” > R 
defined on the direct product E x I” = {(x,t) €R™*™” |x € EAt € I") of the set 
E and the n-dimensional interval J” is continuous, then the function F defined by 
(17.1) for E; = E is continuous on J”. 

c) Let P = {(x, y) €R* |a<x<bAc<y <d}, and let f €C(P,R),a,B Ee 
C([c, d], [a, b]). Prove that in that case the function (17.7) is continuous on the 
closed interval [c, d]. 


2. a) Prove that if f € C(R, R), then the function F(x) = + i f( +1) dt is not 
only continuous, but also differentiable on R. 
b) Find the derivative of this function F(x) and verify that F ¢ C(R, R). 


3. Using differentiation with respect to the parameter, show that for |r| < 1 
we 
F(r)= i In(1 — 2r cos x +r”) dx =0. 
0 


4. Verify that the following functions satisfy Bessel’s equation of Example 2: 


a) u=x" i cos(x cos) sin?” y dg; 


b) Jn (x) = oon Jd — 12)-1/2) cos xt dt. 
c) Show that the functions J, corresponding to different values of n € N are 
connected by the relation Jn41 = Jn—1 — 2J;. 


5. Developing Example 3 and setting k:= V1 — BP, E(k) = E(k), K(k) = K(k), 
show, following Legendre, that 


a) £(EK + EK — KK)=0. 
b) EK+EK—KK =n/2. 


6. Instead of the integral (17.2), consider the integral 


b 
Fopz i; F(x, et)ax, 


where g is a function that is integrable over the closed interval [a, b](g € R[a, b]). 


412 17 Integrals Depending on a Parameter 
By repeating the proofs of Propositions 1-3 above verify successively that 


a) if the function f satisfies the hypotheses of Proposition 1, then F is continu- 
ous on [c, d] (F € C[c, d]); 

b) if f satisfies the hypotheses of Proposition 2, then F is continuously differ- 
entiable on [c,d] (F € C[c, d]), and 


Ur) 
Fy)= / (x, y)g(a) dr: 
a Oy 


c) if f satisfies the hypotheses of Proposition 3, then F is integrable over [c, d] 


(F € Ric, d]) and 
d b d 
i FO) / (/ Fs y)gta) dy) a 


7. Taylor’s formula and Hadamard’s lemma. 


a) Show that if f is a smooth function and f (0) = 0, then f(x) = xg(x), where 
gy is a continuous function and y(0) = f’(0). 

b) Show that if f ¢C™ and f (0) =0 fork =0,1,...,n —1, then f(x) = 
x" p(x), where ¢ is a continuous function and g(0) = a FO), 

c) Let f be a C™ function defined in a neighborhood of 0. Verify that the 
following version of Taylor’s formula with the Hadamard form of the remainder 
holds: 


1 
(n—1)! 


f(x) = fO)+ = f'Ox feet FEY Ox"! +x" gx), 


where ¢ is a function that is continuous on a neighborhood of zero, and g(0) = 
af” (0). 

d) Generalize the results of a), b), and c) to the case when f is a function of 
several variables. Write the basic Taylor formula in multi-index notation: 


n—-1 


1 
Fa)= DP FP*FOx* + D7 x* a(x), 


la|=0 * lja|=n 


and note in addition to what was stated in a), b), and c), that if f ¢ C*??, that 
Ya € Cc). 


17.2 Improper Integrals Depending on a Parameter 413 
17.2 Improper Integrals Depending on a Parameter 


17.2.1 Uniform Convergence of an Improper Integral with Respect 
to a Parameter 


a. Basic Definition and Examples 


Suppose that the improper integral 


Fo)= [ f(x, y) dx (17.10) 


over the interval [a,w] C R converges for each value y € Y. For definiteness we 
shall assume that the integral (17.10) has only one singularity and that it involves 
the upper limit of integration (that is, either @ = +00 or the function f is unbounded 
as a function of x in a neighborhood of ). 


Definition We say that the improper integral (17.10) depending on the parameter 
y €Y converges uniformly on the set E C Y if for every ¢ > 0 there exists a neigh- 
borhood Uja,«(@) of @ in the set [a, w[ such that the estimate 


I f(x, y)dx| <e (17.11) 
b 


for the remainder of the integral (17.10) holds for every b € Uja,at(@) and every 
yee. 
If we introduce the notation 


b 
Fy(y):= | f(x, y)dx (17.12) 


for a proper integral approximating the improper integral (17.10), the basic defi- 
nition of this section can be restated (and, as will be seen in what follows, very 
usefully) in a different form equivalent to the previous one: 

uniform convergence of the integral (17.10) on the set E C Y by definition means 
that 


Fh) 3 Fy) onE asb>a, bé[a,oal. (17.13) 
Indeed, 
o b 
Fo)= [fenders jim fo fe.yae= Jim AG), 
Ge bef[a,o[ ¢ be[a,ol 


and therefore relation (17.11) can be rewritten as 


|FO) — Fo(y)| <e. (17.14) 
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This last inequality holds for every b € Uja,p{(@) and every y € E, as shown in 
(17.13). 

Thus, relations (17.11), (17.13), and (17.14) mean that if the integral (17.10) 
converges uniformly on a set EF of parameter values, then this improper integral 
(17.19) can be replaced by a certain proper integral (17.12) depending on the same 
parameter y with any preassigned precision, simultaneously for all y € E. 


ie dx 
{wey 


converges uniformly on the entire set IR of values of the parameter y € R, since for 
every yER 


Example I The integral 


=—_ <¢£, 


i dx pte de 
b x2 4 y2 — b x? b 


provided b > 1/e. 


Example 2 The integral 


+00 
i: e dx, 
0 


obviously converges only when y > 0. Moreover it converges uniformly on every 
set {y € R| y= yo > O}. 
Indeed, if y > yo > 0, then 


0 1 1 
O0< / e*) dx = —e7 87 < —e- 9 +0 ashb— -+too. 
b y YO 


At the same time, the convergence is not uniform on the entire set Ry = {y € 
R| y > O}. Indeed, negating uniform convergence of the integral (17.10) on a set E 
means that 

> 7) 7 


@ 
dep > OVB E€ [a,a[ SD €[B, ol dye E (|/ St (x, y)dx 
b 


In the present case ¢9 can be taken as any real number, since 
+00 1 
/ e-*) dx = —e- 9” + +00, as y—> 40, 
b y 


for every fixed value of b € [0, +o00[. 
Let us consider a less trivial example, which we shall be using below. 


Example 3 Let us show that each of the integrals 


+00 
@(x) -|/ gyri Cray dy, 
0 
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+00 
F(y)= | yet Pre tay dx, 
0 


in which q@ and £ are fixed positive numbers, converges uniformly on the set of 
nonnegative values of the parameter. 
For the remainder of the integral ®(x) we find immediately that 


+00 
O0< i xt yet Bt le-“ IED dy = 
b 


+00 +00 
= i (xy)"e*?yP +16") dy < My / yP+le-¥ dy, 
b b 


where My = maxo<y<+o0 ue “. Since this last integral converges, it can be made 
smaller than any preassigned ¢ > 0 for sufficiently large values of b € R. But this 
means that the integral ®(x) converges uniformly. 

Let us now consider the remainder of the second integral F(y): 


+00 
0< i gh yet rl ray dx = 
b 


+00 


+00 
= yee? | (xy)*e ~ ydx = yee? [ ure“ du. 
b by 


Since 


+00 +00 
i uve “du < i u~e “du < +o0, 
b 0 


y 


for y >0 and ye~Y > Oas y > 0, for each ¢ > 0 there obviously exists a number 
yo > O such that for every y € [0, yo] the remainder of the integral will be less than 
€ even independently of the value of b € [0, +00[. 

And if y > yo > 0, taking account of the relations Mg = maxo<y<+00 yb ev< 
+oo and 0 < tas ure“ du < ee ue" du + 0 as b > +00, we conclude that 
for all sufficiently large values of b € [0, ++-oo[ and simultaneously for all y > yo > 0 
the remainder of the integral Fy) can be made less than e. 

Combining the intervals [0, yo] and [yo, +-oo[, we conclude that indeed for every 
€ > 0 one can choose a number B such that for every b > B and every y > 0 the 
corresponding remainder of the integral F'(y) will be less than e. 


b. The Cauchy Criterion for Uniform Convergence of an Integral 


Proposition 1 (Cauchy criterion) A necessary and sufficient condition for the im- 
proper integral (17.10) depending on the parameter y € Y to converge uniformly on 
aset E CY is that for every € > 0 there exist a neighborhood Uja,«{(@) of the point 
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w@ such that 
b2 
i f(x, y)dx| <eé (17.15) 
by 


for every bi, bz € Uta at (@) and every y € E. 


Proof Inequality (17.15) is equivalent to the relation | F»,(y) — Fp, (y)| < €, so that 
Proposition | is an immediate corollary of the form (17.13) for the definition of 
uniform convergence of the integral (17.10) and the Cauchy criterion for uniform 
convergence on E of a family of functions F»(y) depending on the parameter b € 
[a, of. 


As an illustration of the use of this Cauchy criterion, we consider the following 
corollary of it, which is sometimes useful. 


Corollary 1 [f the function fin the integral (17.10) is continuous on the set [a, w[ x 
[c, d] and the integral (17.10) converges for every y € |c, d[ but diverges for y =c 
or y =d, then it converges nonuniformly on the interval |c, d[ and also on any set 
E C Jc, d[ whose closure contains the point of divergence. 


Proof If the integral (17.10) diverges at y = c, then by the Cauchy criterion for con- 


vergence of an improper integral there exists ¢9 > 0 such that in every neighborhood 
Uta,o[(@) there exist numbers b;, by for which 


bz 
i f(x,c) dx 
by 


by 
f(x, y) dx 
by 


> £0. (17.16) 


The proper integral 


is in this case a continuous function of the parameter y on the entire closed interval 
[c, d] (see Proposition | of Sect. 17.1), so that for all values of y sufficiently close 


to c, the inequality 
bz 
| / f(x, y) dx 
by 


will hold along with the inequality (17.16). 
On the basis of the Cauchy criterion for uniform convergence of an improper in- 

tegral depending on a parameter, we now conclude that this integral cannot converge 

uniformly on any subset E C Jc, d[ whose closure contains the point c. 
The case when the integral diverges for y = d is handled similarly. 


>e€é 
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+oo 
; ee dx 
0 


converges for t > 0 and diverges at t = 0, hence it demonstrably converges nonuni- 
formly on every set of positive numbers having 0 as a limit point. In particular, it 
converges nonuniformly on the whole set {t € R | t > 0} of positive numbers. 

In this case, one can easily verify these statements directly: 


Example 4 The integral 


+00 1 +00 
—tx? —u? 
i e dx = — e du—-+00 ast— +0. 
b 


Vt Sofi 


We emphasize that this integral nevertheless converges uniformly on any set {t € 
R | t > to > O} that is bounded away from 0, since 


1 OO" 2% 1 oe 2 
0< — e aus — f e“ du>0 asb—> +o. 
Jt b./t V'to b./Jig 


c. Sufficient Conditions for Uniform Convergence of an Improper Integral 
Depending on a Parameter 

Proposition 2 (The Weierstrass test) Suppose the functions f (x, y) and g(x, y) are 
integrable with respect to x on every closed interval [a, b] C [a, w[ for each value 


of yEY. 
If the inequality | f (x, y)| < g(x, y) holds for each value of y € Y and every 


x €[a, o[ and the integral 
@ 
/ g(x, y)dx 
a 


converges uniformly on Y, then the integral 


i f(x, y) dx 


converges absolutely for each y € Y and uniformly on Y. 


Proof This follows from the estimates 


by 
if f(x, y)dx 
by 


and Cauchy’s criterion for uniform convergence of an integral (Proposition 1). 


bo by 
<| Pelee sf g(x, y)dx 


by 


The most frequently encountered case of Proposition 2 occurs when the function 
g is independent of the parameter y. It is this case in which Proposition 2 is usually 
called the Weierstrass M-test for uniform convergence of an integral. 
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Example 5 The integral 


°° cos ax 
aw at 
0 1 + Xx 
converges uniformly on the whole set R of values of the parameter a, since 


cosax; <— _ 1 : Co dx 
| re |< i¢x?? and the integral i Tn x2 COnverges. 


: . : : 2 2 : 
Example 6 In view of the inequality | sinx e~" | < e~’, the integral 


oS 2 
/ sinxe dx, 
0 


as follows from Proposition 2 and the results of Example 3, converges uniformly on 
every set of the form {tf € R| t > to > 0}. Since the integral diverges for t = 0, on 
the basis of the Cauchy criterion we conclude that it cannot converge uniformly on 
any set having zero as a limit point. 


Proposition 3 (Abel—Dirichlet test) Assume that the functions f (x, y) and g(x, y) 
are integrable with respect to x at each y € Y on every closed interval [a, b] C 
[a, of. 

A sufficient condition for uniform convergence of the integral 


/ (fF -e)@, sae 


on the set Y is that one of the following two pairs of conditions holds: 


a) either there exists a constant M € R such that 


b 
i Fx, y) dx 


for any b € [a, w[ and any y € Y and 
B,) for each y € Y the function g(x, y) is monotonic with respect to x on the inter- 
val [a, w[ and g(x, y) 2 0onYasx—> a,x €[a, ol, 


<M 


or 


a2) the integral 


/ f(x, y) dx 


converges uniformly on the set Y and 
B2) for each y € Y the function g(x, y) is monotonic with respect to x on the inter- 
val [a, w[ and there exists a constant M € R such that 


|g. y)]| <M 


for every x € [a, w[ and every ye Y. 


17.2 Improper Integrals Depending on a Parameter 419 


Proof Applying the second mean-value theorem for the integral, we write 


bo é bo 
| (F-a)Gs,y)dx = a.y) f foe y)det gtba.») [ Flevae, 
1 1 


where & € [b), bz]. If b; and b2 are taken in a sufficiently small neighborhood 
Uta,a{(@) of the point w, then the right-hand side of this equality can be made 
smaller in absolute value than any prescribed ¢ > 0, and indeed simultaneously for 
all values of y € Y. In the case of the first pair of conditions a), 61) this is obvious. 
In the case of the second pair a2), 62), it becomes obvious if we use the Cauchy 
criterion for uniform convergence of the integral (Proposition 1). 

Thus, again invoking the Cauchy criterion, we conclude that the original integral 
of the product f - g over the interval [a, w[ does indeed converge uniformly on the 
set Y of parameter values. 


Example 7 The integral 


+ sin x 
dx, 
1 x 


as follows from the Cauchy criterion and the Abel—Dirichlet test for convergence 
of improper integrals, converges only for a > 0. Setting f(x, a) = sinx, g(x,a) = 
x~°, we see that the pair a,), 6,) of hypotheses of Proposition 3 holds for a > 
ag > 0. Consequently, on every set of the form {a € R| a > ap > 0} this integral 
converges uniformly. On the set {a € R | aw > 0} of positive values of the parameter 
the integral converges nonuniformly, since it diverges at a = 0. 


oO: 
sinx _,.,, 
——e ** dx 

0 X 


converges uniformly on the set {y € R| y > O}. 


Example § The integral 


Proof First of all, on the basis of the Cauchy criterion for convergence of the im- 


proper integral one can easily conclude that for y < 0 this integral diverges. Now 
assuming y > 0 and setting f(x, y) = “S*, g(x, y) =e~*”, we see that the second 


pair a2), 62) of hypotheses of Proposition 3 holds, from which it follows that this 
integral converges uniformly on the set {y € R| y > O}. 


Thus we have introduced the concept of uniform convergence of an improper 
integral depending on a parameter and indicated several of the most important tests 
for such convergence completely analogous to the corresponding tests for uniform 
convergence of series of functions. Before passing on, we make two remarks. 


Remark 1 So as not to distract the reader’s attention from the basic concept of uni- 
form convergence of an integral introduced here, we have assumed throughout that 
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the discussion involves integrating real-valued functions. At the same time, as one 
can now easily check, these results extend to integrals of vector-valued functions, in 
particular to integrals of complex-valued functions. Here one need only note that, as 
always, in the Cauchy criterion one must assume in addition that the corresponding 
vector space of values of the integrand is complete (this is the case for R, C, R”, 
and C”); and in the Abel—Dirichlet test, as in the corresponding test for uniform 
convergence of series of functions, the factor in the product f - g that is assumed to 
be a monotonic function, must of course be real-valued. 


Everything that has just been said applies equally to the main results of the fol- 
lowing subsections in this section. 


Remark 2 We have considered an improper integral (17.10) whose only singular- 
ity was at the upper limit of integration. The uniform convergence of an integral 
whose only singularity is at the lower limit of integration can be defined and stud- 
ied similarly. If the integral has a singularity at both limits of integration, it can be 
represented as 


a2 c @2 
i: fee. ydx= [ fe. ydx+ | Pesan: 
w{ c 


a} 


where c € Ja}, w2[, and regarded as uniformly convergent on a set E C Y if both of 
the integrals on the right-hand side of the equality converge uniformly. It is easy to 
verify that this definition is unambiguous, that is, independent of the choice of the 
point c € Ja, @2[. 


17.2.2 Limiting Passage Under the Sign of an Improper Integral 
and Continuity of an Improper Integral Depending 
on a Parameter 


Proposition 4 Let f(x, y) be a family of functions depending on a parameter y € Y 
that are integrable, possibly in the improper sense, on the interval a < x < w, and 
let By be a base inY. 


If 
a) for every b € [a, a[ 


f(x,y) = g(x) on[a, b] over the base By 


and 
b) the integral ios J (x, y) dx converges uniformly on Y, 


then the limit function @ is improperly integrable on [a, w| and the following equal- 
ity holds: 


tim ffx, ya = [ owar. (17.17) 
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Proof The proof reduces to checking the following diagram: 


b w 
Poy) = JS f@y)de ==> J f(x,y) dx =: F(y) 
a bE [a,w[ — 4 
By a a By 
b a w 
f ola) de —- fee) ax 
cy bE [a,w[ cs 


The left vertical limiting passage follows from hypothesis a) and the theorem on 
passage to the limit under a proper integral sign (see Theorem 3 of Sect. 16.3). 

The upper horizontal limiting passage is an expression of hypothesis b). 

By the theorem on the commutativity of two limiting passages it follows from 
this that both limits below the diagonal exist and are equal. 

The right-hand vertical limit passage is what stands on the left-hand side of 
Eq. (17.17), and the lower horizontal limit gives by definition the improper inte- 
gral on the right-hand side of (17.17). 


The following example shows that condition a) alone is generally insufficient to 
guarantee Eq. (17.17) in this case. 


Example 9 Let Y= {y € R| y > 0} and 


_Jil/y, ifO0<x<y, 
fad= {9 ify <x. 


Obviously, f(x, y) = 0 on the interval 0 < x < +00 as y > +00. At the same 
time, for every ye Y, 


+00 


» Yq 
fe ydr= f° fe,yar= f° ax =, 
0 0 y 
and therefore Eq. (17.17) does not hold in this case. 


Using Dini’s theorem (Proposition 2 of Sect. 16.3), we can obtain the following 
sometimes useful corollary of Proposition 4. 


Corollary 2 Suppose that the real-valued function f (x, y) is nonnegative at each 
value of the real parameter y € Y C R and continuous on the intervala <x <a. 


If 


a) the function f (x, y) is monotonically increasing as y increases and tends to 
a function (x) on [a, of, 

b) g € C({a, a[, R), and 

c) the integral f i g(x) dx converges, 


then Eq. (17.17) holds. 
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Proof It follows from Dini’s theorem that f(x, y) = g(x) on each closed interval 
[a,b] C [a, of. 

It follows from the inequalities 0 < f(x, y) < g(x) and the Weierstrass M-test 
for uniform convergence that the integral of f(x, y) over the interval a <x <w 
converges uniformly with respect to the parameter y. 

Thus, both hypotheses of Proposition 4 hold, and so Eq. (17.17) holds. 


Example 10 In Example 3 of Sect. 16.3 we verified that the sequence of functions 
fr) =n - x!/") is monotonically increasing on the interval 0 < x < 1, and 
tr) 7 Int asn —> +00. 

Hence, by Corollary 2 


1 1 
1 
lim n(x") ax = f In - dx. 
xX 


noo 0 0 


Proposition 5 /f 


a) the function f(x, y) is continuous on the set {(x, y) € R? Ja<x<@Ac< 
y <d}, and 

b) the integral F(y) = fe f(x, y) dx converges uniformly on [c,d], then the 
function F (y) is continuous on [c,d]. 


Proof It follows from hypothesis a) that for any b € [a, w[ the proper integral 


b 
Fo) = | Fe, jaex 


is a continuous function on [c, d] (see Proposition | of Sect. 17.1). 
By hypothesis b) we have F,(y) = F(y) on [c,d] as b> a, b € [a, o[, from 
which it now follows that the function F'(y) is continuous on [c, d]. 


Example 11 It was shown in Example 8 that the integral 
7? Bie 
F(y)= —e "dx (17.18) 
0 Xx 


converges uniformly on the interval 0 < y < +00. Hence by Proposition 5 one can 
conclude that F'(y) is continuous on each closed interval [0, d] Cc [0, +o00[, that is, 
it is continuous on the entire interval 0 < y < +o. In particular, it follows from this 
that 

+00 


; sinx _, + gin x 
lim —e Ydx= —— dx. (17.19) 
y> +0 Jo x 0 x 
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17.2.3 Differentiation of an Improper Integral with Respect 
to a Parameter 


Proposition 6 /f 


a) the functions f(x,y) and fh (x, y) are continuous on the set {(x, y) € R? | 
a<x<wAc<y<d}, 

b) the integral ®(y) = i. i (x, y) dy converges uniformly on the set Y = [c,d], 
and 

c) the integral F(y) = i FS (x, y) dx converges for at least one value of yo € Y, 


then it converges uniformly on the whole set Y. Moreover the function F(y) is dif- 
ferentiable and the following equality holds: 


w 
Fy) = / fix, ydx. 
a 
Proof By hypothesis a), for every b € [a, w[ the function 


b 
Fao) = | f(x, y) dx 


is defined and differentiable on the interval c < y < d and by Leibniz’ rule 


b 
(Fs)'(y) = i fie y) de. 


By hypothesis b) the family of functions (F,)'(y) depending on the parameter 
b € [a, w[ converges uniformly on [c, d] to the function ®(y) asb > w, be [a, af. 

By hypothesis c) the quantity F, (yo) has a limit as b > w, b € [a, a. 

It follows from this (see Theorem 4 of Sect. 16.3) that the family of functions 
Fy(y) itself converges uniformly on [c, d] to the limiting function F(y) as b > a, 
b € [a, o[, the function F is differentiable on the interval c < y < d, and the equality 
F’(y) = ®(y) holds. But this is precisely what was to be proved. 


Example 12 For a fixed value a > 0 the integral 


+00 
[ocr 
0 


converges uniformly with respect to the parameter y on every interval of the form 
{y € R| y => yo > O}. This follows from the estimate 0 < x%e*? < x%e770 < 
yo 


e “2, which holds for all sufficiently large x € R. 
Hence, by Proposition 6, the function 


+00 
F(y)= / e dx 
0 
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is infinitely differentiable for y > 0 and 
+00 
F™ (y) - (=1)" 7, xe? dx. 
0 


But F(y) = re and therefore F(y) = (—1)" =a and consequently we can 


Oo n! 
[ete 
0 y 


conclude that 


In particular, for y = 1 we obtain 


+00 
x"e* dx =n. 
0 


Example 13 Let us compute the Dirichlet integral 


+ sin x 
—— dx 
0 Xx 


To do this we return to the integral (17.18), and we remark that for y > 0 
+00 
F'(y) = -| sinxe * dx, (17.20) 
0 


since the integral (17.20) converges uniformly on every set of the form {y € R| y> 
yo > O}. 

The integral (17.20) is easily computed from the primitive of the integrand, and 
the result is that 


F'(y)=- for y > 0, 


1 
1+ y? 
from which it follows that 


F(y)=-—arctany+c fory>0. (17.21) 


We have F(y) — 0 as y > +00, as can be seen from relation (17.18), so that 
it follows from (17.21) that c = 2/2. It now results from (17.19) and (17.21) that 
F(O) =2/2. Thus, 


+ sin x ba 
aa ee (17.22) 
0 Xx 2 


We remark that the relation “F'(y) > 0 as y > +00” used in deriving (17.22) is 
not an immediate corollary of Proposition 4, since “!*e~*” = 0 as y > +00 only 
on intervals of the form {x € R| x > xo > O}, while the convergence is not uniform 
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on intervals of the form 0 < x < xo: for sind @— XY > las x > 0. But for x9 > 0 we 
have 


Og XO oj +00 ¢: 
sinx _.. sinx _.. sinx _.., 
i ee var = f ee vant f SINS 6-2 dy 
0 0 x x x 


a 0 


and, given € > 0 we first choose xg so close to 0 that sinx > 0 for x € [0, xo] and 


*0 sinx _. *0 sin x E 
O< —e dx < — dx < = 
0 x 0 Xx 2 


for every y > 0. Then, after fixing xo, on the basis of Proposition 4, by letting y 
tend to +00, we can make the integral over [x9, +00[ also less than ¢/2 in absolute 
value. 


17.2.4 Integration of an Improper Integral with Respect 
to a Parameter 


Proposition 7 /f 


a) the function f(x, y) is continuous on the set {(x, y) € R? jJa<x<@Ac< 
y <d}and 

b) the integral F(y) = i Ff (x, y) dx converges uniformly on the closed interval 
[c,d], 


then the function F is integrable on [c,d] and the following equality holds: 


d @ @ d 
[of fo. ydx= f ax [ f(x, y)dy. (17.23) 


Proof For b € [a, w[, by hypothesis a) and Proposition 3 of Sect. 17.1 for improper 
integrals one can write 


d b b d 
[of fee. yax= f ax [ f(x, y)dy. (17.24) 


Using hypothesis b) and Theorem 3 of Sect. 16.3 on passage to the limit under 
an integral sign, we carry out a limiting passage on the left-hand side of (17.24) as 
b > a, b € [a, w[ and obtain the left-hand side of (17.23). By the very definition 
of an improper integral, the right-hand side of (17.23) is the limit of the right-hand 
side of (17.24) as b> a, b € [a, w[. Thus, by hypothesis b) we obtain (17.23) from 
(17.24) asb—> w, be [a, af. 


The following example shows that, in contrast to the reversibility of the order of 
integration with two proper integrals, condition a) alone is in general not sufficient 
to guarantee (17.23). 
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Example 14 Consider the function f(x, y) = (2 — xy)xye~*” on the set {(x, y) € 
R* |0< x <+00 A0<y <1}. Using the primitive u*e~” of the function (2 — 
u)ue“, it is easy to compute directly that 


1 +00 +00 1 
o= | ay [ (2—xy)xye *” dx al ax [ (2—xy)xye Ydy=l. 
0 0 0 0 


Corollary 3 /[f 


a) the function f(x,y) is continuous on the set P = {(x,y) € R? ja<x< 
woANc<y<d}and 

b) nonnegative on P, and 

c) the integral F(y) = ft Ff (x, y) dx is continuous on the closed interval [c, d] 
as a function of y, 


then Eq. (17.23) holds. 


Proof It follows from hypothesis a) that for every b € [a, w[ the integral 


b 
Foy = | f(x, y) dx 


is continuous with respect to y on the closed interval [c, d]. 

It follows from b) that Fp, (y) < Fp, (y) for by < bo. 

By Dini’s theorem and hypothesis c) we now conclude that F, — F on [c, d] as 
b>o,beé[a, al. 

Thus the hypotheses of Proposition 7 are satisfied and consequently Eq. (17.23) 
indeed holds in the present case. 


Corollary 3 shows that Example 14 results from the fact that the function f(x, y) 
is not of constant sign. 

In conclusion we now prove a sufficient condition for two improper integrals to 
commute. 


Proposition 8 /f 


a) the function f(x, y) is continuous on the set {(x, y) € IR? jJa<x<@Ac< 
y <o}, 
b) both integrals 


Fo)= f ees o()=f f(x, y)dy 


converge uniformly, the first with respect to y on any closed interval [c, d] C [c, o], 
the second with respect to x on any closed interval [a, b] C [a, w[, and 
c) at least one of the iterated integrals 


fof fl, y)dx, / ax [ fle, y) dy 
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converges, then the following equality holds: 


fof fe yar= fo ax [" f(x, y) dy. (17.25) 


Proof For definiteness suppose that the second of the two iterated integrals in c) 
exists. 

By condition a) and the first condition in b) one can say by Proposition 7 that 
Eq. (17.23) holds for the function f for every d € [c, @[. 

If we show that the right-hand side of (17.23) tends to the right-hand side of 
(17.25) as d > @, d € [c, @[, then Eq. (17.25) will have been proved, since the left- 
hand side will then also exist and be the limit of the left-hand side of Eq. (17.23) by 
the very definition of an improper integral. 

Let us set 


d 
Da(x) =f f(x, y)dy. 


The function ®g is defined for each fixed d € [c, @[ and, since f is continuous, 
@, is continuous on the interval a < x <o. 

By the second of hypotheses b) we have g(x) = ®(x) asd > @, d € [c, @[ on 
each closed interval [a, b] C [a, af. 

Since |@q(x)| < fe | f\(x, y)dy =: G(x) and the integral fe? G(x) dx, which 
equals the second integral in hypothesis c), converges by hypothesis, we conclude 
by the Weierstrass M-test for uniform convergence that the integral i. Pa (x) dx 
converges uniformly with respect to the parameter d. 

Thus the hypotheses of Proposition 4 hold, and we can conclude that 


(2) 
lim, da(xyar = | P(x) dx; 
d>@ a 


de[c,a] 


and that was precisely what remained to be verified. 


The following example shows that the appearance of the extra hypothesis c) in 
Proposition 8 in comparison with Proposition 7 is not accidental. 


Example 15 Computing the integral 


[~ x2 _ ye x +00 A 1 
dx = = > < — 
a GER |, AHN A 


for A > 0 shows at the same time that for every fixed value of A > 0 it converges 
uniformly with respect to the parameter y on the entire set of real numbers R. The 
same thing could have been said about the integral obtained from this one by replac- 
ing dx with dy. The values of these integrals happen to differ only in sign. A direct 
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computation shows that 


1 [raf se, ae wef a fs x? — y? a 
= X 3 
4 Ja A @+yQ2°7 i aa 


Example 16 For a > 0 and £ > 0 the iterated integral 


+00 +00 +00 +00 
i ay [ xX yet Bley dy = yPe-¥ ay [ (xy)%e"  y dx 
0 0 0 


of a nonnegative continuous function exists, as this identity shows: it equals zero for 
y=Oand f.°* y8e-) dy - fo7° u%e~“ du for y > 0. Thus, in this case hypotheses 
a) and c) of Proposition 8 hold. The fact that both conditions of b) hold for this 
integral was verified in Example 3. Hence by Proposition 8 we have the equality 


+00 +00 +00 +00 
i ay [ Bey eth he eee dx =| ax [ ahr re Vn dy, 
0 0 0 0 


Just as Corollary 3 followed from Proposition 7, we can deduce the following 
corollary from Proposition 8. 


Corollary 4 /f 


a) the function f (x, y) is continuous on the set 
={(x,y) eR? |a<x<wac<y <a}, and 


b) is nonnegative on P, and 
c) the two integrals 


ro)= [ (Gee o(x)= | fle.y)dy 


are continuous functions on [a, w[ and [c, &[ respectively, and 
d) at least one of the iterated integrals 


[of f(x, y) dx, i ax [ f(x, y) dy, 


exists, then the other iterated integral also exists and their values are the same. 


Proof Reasoning as in the proof of Corollary 3, we conclude from hypotheses a), 
b), and c) and Dini’s theorem that hypothesis b) of Proposition 8 holds in this case. 
Since f > 0, hypothesis d) here is the same as hypothesis c) of Proposition 8. Thus 
all the hypotheses of Proposition 8 are satisfied, and so Eq. (17.24) holds. 


Remark 3 As pointed out in Remark 2, an integral having singularities at both limits 
of integration reduces to the sum of two integrals, each of which has a singularity 
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at only one limit. This makes it possible to apply the propositions and corollaries 
just proved to integrals over intervals ]w1,@2[ C R. Here naturally the hypotheses 
that were satisfied previously on closed intervals [a, b] C [a, w[ must now hold on 
closed intervals [a, b] C J}, w2[. 


Example 17 By changing the order of integration in two improper integrals, let us 
show that 


TO. 39 1 
. e* dx = —/z. (17.26) 
0 2 
This is the famous Euler—Poisson integral. 


Proof We first observe that for y > 0 


+00 2 +00 9 
oy ee au=y f e "dx, 
0 0 


and that the value of the integral in (17.26) is the same whether it is taken over the 
half-open interval [0, +o0[ or the open interval ]0, +oo[. 
Thus, 


+00 4 +00 5 too g +00 5 ; 
; ye ay [ ey) av= | e> ay [ ee“ du=J°, 
0 0 0 0 


and we assume that the integration on y extends over the interval ]0, +-oo[. 
As we shall verify, it is permissible to reverse the order of integration over x and 
y in this iterated integral, and therefore 


i + oF 
7 =f lee) ax f ioe) yen (ite)? dy _ 1 / oC ~—hdx = 4 
0 0 2 0 14x? 4 


from which Eq. (17.26) follows. 
Let us now justify reversing the order of integration. 
The function 


1 1 
214+ x2 


+ 
i ye 499092 dy = 
0 


is continuous for x > 0, and the function 
+00 
2y),,2 ae 
/ sp I ig ee 
0 


is continuous for y > 0. Taking account of the general Remark 3, we now conclude 
from Corollary 4 that this reversal in the order of integration is indeed legal. 
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17.2.5 Problems and Exercises 


1. Let a=ap <a, <--: <a, <--: <q. We represent the integral (17.10) as the 
sum of the series py 1 n(y), where @p(y) = Ee ; f(x, y) dx. Prove that the inte- 
gral converges uniformly on the set EF C Y if and only if to each sequence {a,} of 
this form there corresponds a series }“~_, g,(y) that converges uniformly on E. 

2. a) In accordance with Remark | carry out all the constructions in Sect. 17.2.1 
for the case of a complex-valued integrand f. 


b) Verify the assertions in Remark 2. 


3. Verify that the function Jo(x) = i i cosxt_ dt satisfies Bessel’s equation y” + 


a/1-b? 


ty’ +y=0. 
: : +oo dy _ 1 = 
4. a) Starting from the equality ie re 5, Show that A ees arr = 5- 
(2n-3)!) 
(2n—2)!) © y2n-T* 
é +00 dy __ x (2n—3)!! 
b) Verify that /, dig = 3 Ona. 


c) Show that (1 + (y?/n))-” \ e-”” onRasn> +oo and that 


+00 dy +00 y 
lim i" oo / e” dy. 
n>+ooJg (1+ (y*/n))" Jo 


d) Obtain the following formula of Wallis: 


km CA} 
n>00 (In—2Q)) Jw 


5. Taking account of Eq. (17.26), show that 


a ig e-*” cos 2xy dx = 1 fae”. 
b) fre sin2xydx =e" fe” de. 


6. Assuming t > 0, prove the identity 


TOO eT ix + sin(x — ft) 
—~ dx = ——— _ dx, 
0 1+ x? t x 


using the fact that both of these integrals, as functions of the parameter f, satisfy the 
equation y + y= 1/t and tend to zero as t > +00. 


7. Show that 
. ! arctan x 
i K(k) dk = [~ * ao(=[ ar), 
0 sing 


where K(k) = ne * __dv ____ ig the complete elliptic integral of first kind. 


J 1—k? sin? g 
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8. a) Assuming that a > 0 and b > 0 and using the equality 


+00 b +00 g-dx _e 
/ dx ii e dy = i ated DET 
0 a 0 x 


compute this last integral. 
b) For a > 0 and b > 0 compute the integral 


+00 g-ax _ ex 
—————— cos x dx. 
0 Xx 


c) Using the Dirichlet integral (17.22) and the equality 


FOO dy fo. + cosax — cosbx 
— | sinxydy= ——,— dr, 
0 xX Ja 0 x 


compute this last integral. 


9. a) Prove that for k > 0 


+00 +00 ‘ +00 oe 
i e ‘sine dt f e fH au = f au [ e ktH)! sin t dt. 
0 0 0 0 


b) Show that the preceding equality remains valid for the value k = 0. 
c) Using the Euler—Poisson integral (17.26), verify that 


1 2 00 2 
Meee i; ent dy, 
Jt VT JO 


d) Using this last equality and the relations 


+00 2 1 ft® sint “FOO > 1 (t® cost 
sinx* dx = = —— dt, cosx* dx == —— dt, 
0 2Jo vt 0 2Jo vt 


obtain the value G/F ) for the Fresnel integrals 


+00 +00 
i sin x? dx, i cosx? dx. 
0 0 


10. a) Use the equality 


+ sin x TOS ee 
—dx= sinx dx e ** dy 
0 x 0 0 


and, by justifying a reversal in the order of integration in the iterated integral, obtain 
once again the value of the Dirichlet integral (17.22) found in Example 13. 
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b) Show that fora > 0 and 6 > 0 


ge + 
: 5, ifB <a, 

+© sinax a” p 
F - cosBxdx= 47, if B=a, 
0, ifp>a. 


This integral is often called the Dirichlet discontinuous factor. 
c) Assuming a > 0 and £ > 0, verify the equality 


[° sinax sin Bx dpe 5B, ifB<a, 
0 


x x Za, ifa<B. 
d) Prove that if the numbers @, a1, ...,@, are positive and a > YS a;, then 
+ sinax sinajx  sind,x a 
vee dx = —a102---Qy. 
0 x x x 2 


11. Consider the integral 


Fuy= | f(x, y)g(x) dx, 


where g is a locally integrable function [a, [ (that is, for each b € [a, w[g|[a,p] € 
Ra, b]). Let the function f satisfy the various hypotheses a) of Propositions 5-8. 
If the integrand f(x, y) is replaced by f(x, y) - g(x) in the other hypotheses of 
these propositions, the results are hypotheses under which, by using Problem 6 of 
Sect. 17.1 and repeating verbatim the proofs of Propositions 5—8, one can conclude 
respectively that 


a) Fe C{c,d]; 
b) FEC Ic, d], and 


» af 
FQ)= / SG y)g(a) de: 
a y 


c) Fe Ric, d| and 


d oO d 
[ Foer= | ¢) Fl »)gtad dy) a 


c) F is improperly integrable on [c, @[, and 


[ Fou= | (/ fs y)gta dy) a 


Verify this. 
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17.3 The Eulerian Integrals 


In this section and the next we shall illustrate the application of the theory devel- 
oped above to some specific integrals of importance in analysis that depend on a 
parameter. 

Following Legendre, we define the Eulerian integrals of first and second kinds 
respectively as the two special functions that follow: 


1 
Bw, B) = [ xoH = ay P-l ay, (17.27) 


+00 
(a) := J x? le dx. (17.28) 
0 


The first of these is called the beta function, and the second, which is the most 
frequently used, is the gamma function of Euler.' 


17.3.1 The Beta Function 


a. Domain of Definition 


A necessary and sufficient condition for the convergence of the integral (17.27) at 
the lower limit is that a > 0. Similarly, convergence at 1 occurs if and only if 6 > 0. 

Thus the function B(a, 8) is defined when both of the following conditions hold 
simultaneously: 


a>0O and 6>0. 
Remark We are regarding a and £ as real numbers here. However, it should be kept 
in mind that the most complete picture of the properties of the beta and gamma 


functions and the most profound applications of them involve their extension into 
the complex parameter domain. 


b. Symmetry 


Let us verify that 
Bia, B) = B(B, a). (17.29) 


Proof It suffices to make the change of variable x = | — ¢ in the integral (17.27). 


'L. Euler (1707-1783), a brilliant scientist and above all a mathematician and specialist in me- 
chanics. If one were to select a name, after the names of Newton and Leibniz, for a professional 
mathematician, that name would likely be pronounced “Euler”. Euler’s works and ideas still per- 
meate almost all areas of modern mathematics. Swiss by birth, he spent a significant part of his life 
living and working in Russia, where he was buried. 
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c. The Reduction Formula 


If a > 1, the following equality holds: 


a—l 


Be = eae 


Bia — 1, B). (17.30) 


Proof Integrating by parts and carrying out some identity transformations for a > | 
and 6 > 0, we obtain 


= 1 
Boa, p) =a —xyAl4 Sf x7 (1 —x)Pdx= 
a-1 ff! 
B Jo 


es a 
~  B , B a 


from which the reduction formula (17.30) follows. 


x®?((1—x)P! — 1 — x8! x) dx = 


Taking account of formula (17.29), we can now write the reduction formula 


B- 
+6 


on the parameter 6, assuming, of course, that 6 > 1. 
It can be seen immediately from the definition of the beta function that B(a, 1) = 
1, and so for n € N we obtain 


B(a, B) = : Bia, B — 1) (17.30’) 
a —1 


n—1 n—2 n—(n-—1) 
B(a,n) = . heat Bia, l)= 
atn—-1 a+n—-2 a+n—(n—1) 
(n— 1)! 
= ; 17.31 
a(a+1)-...-(@a+n—1) one") 
In particular, for m,n € N 
—D!in—1)! 
ten (17.32) 
(m+n-—1)! 


d. Another Integral Representation of the Beta Function 


The following representation of the beta function is sometimes useful: 


Bla p= [> ae (1733) 
0 U+yetb = 
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Proof This representation can be obtained from (17.27) by the change of variables 


ae 
X=Thy: 


17.3.2 The Gamma Function 


a. Domain of Definition 


It can be seen by formula (17.28) that the integral defining the gamma function 
converges at zero only for a > 0, while it converges at infinity for all values of 
a € R, due to the presence of the rapidly decreasing factor e*. 

Thus the gamma function is defined for a > 0. 


b. Smoothness and the Formula for the Derivatives 


The gamma function is infinitely differentiable, and 
+00 
r™ (a) = x in ee 7 de: (17.34) 
0 


Proof We first verify that the integral (17.34) converges uniformly with respect to 
the parameter aw on each closed interval [a,b] C ]0,+c0[ for each fixed value of 
neN. 

If 0 <a <q, then (since x®/* In” x > 0 as x > +0) there exists c, > 0 such 
that 


1 


, a 
lee ln” xe7*| < x2 


for 0 <x < cy. Hence by the Weierstrass M-test for uniform convergence we con- 
clude that the integral 


Cn 1 ; 
i x? * In” xe* dx 
0 


converges uniformly with respect to a on the interval [a, +o0o[. 
Ifa <b <+o, then for x > 1, 


ie ‘in’ xe sales "In" x] e™, 


and we conclude similarly that the integral 


+00 
/ x%! In” x e-* dx 
C 


n 


converges uniformly with respect to a on the interval ]0, b]. 
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Combining these conclusions, we find that the integral (17.34) converges uni- 
formly on every closed interval [a, b] C JO, +o0[. 

But under these conditions differentiation under the integral sign in (17.27) is 
justified. Hence, on any such closed interval, and hence on the entire open interval 
0 <a, the gamma function is infinitely differentiable and formula (17.34) holds. 


c. The Reduction Formula 


The relation 
Tia+l)=al (a) (17.35) 


holds. It is known as the reduction formula for the gamma function. 


Proof Integrating by parts, we find that for a > 0 


+00 ie S56 
I'(a+ 1) =) xte *dx =—x%e * 5 +a xe let ay = 
a 0 


+00 
— af x*le-* dx =al(a). 
0 


Since "(1) = i e-* dx = 1, we conclude that for n € N 
T(n+1)=nal. (17.36) 


Thus the gamma function turns out to be closely connected with the number- 
theoretic function n!. 


d. The Euler—Gauss Formula 


This is the name usually given to the following equality: 


(n — 1)! 


‘a(a+1):...-(atn—1)' (17,37) 


Pa) = im n 


Proof To prove this formula, we make the change of variable x = In i in the integral 
(17.28), resulting in the following integral representation of the gamma function: 


i 
r(a)= | me-1(*) du. (17.38) 
0 u 


It was shown in Example 3 of Sect. 16.3 that the sequence of functions 
fru) =n — u!/") increases monotonically and converges to In(4) on the in- 
terval 0 <u < 1 asn — ov. Using Corollary 2 of Sect. 17.2 (see also Example 10 
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of Sect. 17.2), we conclude that for a > 1 


1 | 1 = 
i int-(<) du = lim ne f (ag ae (17.39) 
0 u no 0 


Making the change of variable u = v” in the last integral, we find by (17.38), 
(17.39), (17.27), (17.29), and (17.31) that 


1 
(a) = lim n® Jo ov"! = v)%! dv = 
n—->co 0 


lim n° B(n,a) = lim n® B(a,n) = 
n—> oo n—>oo 


: @ (n—1)! 
lim n° - : 
n> a(a+1)-...-(a+n—1) 


Applying the reduction formulas (17.30) and (17.35) to the relation (a) = 
limy+ oon B(a,n) just proved for a > 1, we verify that formula (17.37) holds for 
alla > 0. 


e. The Complement Formula 


For 0 <a < | the values a and | — @ of the argument of the gamma function are 
mutually complementary, so that the equality 


P(a)-TU—a)= cag (0<a <1) (17.40) 


is called the complement formula for the gamma function. 


Proof Using the Euler—Gauss formula (17.37) and simple identities, we find that 


: (n — 1)! 
T'(a) QU —a) = lim { n®* x 
noo a(a+1)-...-(a+n-— 1) 
l-a (n— 1)! 
xn = 
(l—a)(2—a)-...-(n—a@) 


1 
= lim({n x 
Jim ( Ol ae) apeen (Ls ee) 


. : )- 
qd-0-%)-...-d-2)@-2a) 
1 


2 2 2 : 
mere Ls); i sans (Lee) 
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Hence for 0 <a < 1 


r@)rd—a)= . I] (17.41) 


But the following expansion is classical: 


lee) a2 
sina = aT] (1 = =). (17.42) 
n 


n=1 


(We shall not take the time to prove this formula just now, since it will be obtained 
as a simple example of the use of the general theory when we study Fourier series. 
See Example 6 of Sect. 18.2.) 

Comparing relations (17.41) and (17.42), we obtain (17.40). 


It follows in particular from (17.40) that 
1 
r(5) =./n. (17.43) 


We observe that 


1 +00 ; +00 2 
Pile =i Oa) edu, 
2 0 0 


and thus we again arrive at the Euler—Poisson integral 


“£00 2 1 
/ e du= — Jz. 
0 2 


17.3.3 Connection Between the Beta and Gamma Functions 


Comparing formulas (17.32) and (17.36), one may suspect the following connec- 
tion: 


_ P@)- TB) 


between the beta and gamma functions. Let us prove this formula. 


Proof We remark that for y > 0 


+00 
T'(a)= yf x%—1e-*) dx, 
0 
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and therefore the following equality also holds: 


-1 
r(a+p)- — yo [7 etp-1,-(4y)e gy 
(+ yet 0 


using which, taking account of (17.33), we obtain 


Fee Tors Bye * 
(Lap yer? 


+00 +00 ' 
-/ Of xe tb-1le-CU+y)x ax) dy= 
0 0 
! +90 “too ~ 
= / (/ ae alae DL 9) dx = 
0 0 
+00 +00 
= i ee (xy)? e779 x ay) dx = 
0 0 


+00 +00 
= / (Pte f gle au) dx = I'(a)- '(B). 
0 0 


All that remains is to explain the equality distinguished by the exclamation point. 
But that is exactly what was done in Example 16 of Sect. 17.2. 


(a+ B)- Bla, B) -[ 


17.3.4 Examples 


In conclusion let us consider a small group of interconnected examples in which the 
special functions B and I” introduced here occur. 


Example 1 


m/2 1 a B 
in®! B-! o dp = —B( ~, =). 17.45 
[ sin gy cos gy dg 5 (5 5) ( i) 


Proof To prove this, it suffices to make the change of variable sin* gy = x in the 
integral. 


Using formula (17.44), we can express the integral (17.45) in terms of the gamma 
function. In particular, taking account of (17.43), we obtain 


m/2 m/2 rc 
/ sin’! pdy = [ cos*—! dy = seid @ . (17.46) 
0 0 2 r() 


Example 2 A one-dimensional ball of radius r is simply an open interval and its 
(one-dimensional) volume Vj (r) is the length (2r) of that interval. Thus Vj (7) = 2r. 
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If we assume that the ((m — 1)-dimensional) volume of the (n — 1)-dimensional 


ball of radius r is expressed by the formula V,—1(r) = cn_ir”~!, then, integrating 
over sections (see Example 3 of Sect. 11.4), we obtain 


ie n- 
Vi(r) = alr _ x2)" dx = 


r 


m/2 
(4 i cos” de) re, 
that is, V,(r) = cyr”, where 


m/2 
m/2 
Cy = 2641 i cos” odg. 
0 


By relations (17.46) we can rewrite this last equality as 


reg 
Ch = VORB 
so that 


pan Gt ®., . 1@ 
VO nae ey 
or, more briefly, 


gant t@ , 
n= + 1- 
(3?) 


But cj = 2, and ['(3) = 3 


1 1 
x1(5) = 57, So that 


2 
C= . 
ee 
Consequently, 
V, ( ) m2 n 
aT) = ry 
ne 
or, what is the same, 
m2 
Vir) = 


(17.47) 
Example 3 It is clear from geometric considerations that dV,(r) = S,—1(r) dr, 
where S,—1(7) is the (7 — 1)-dimensional surface area of the sphere bounding the 
n-dimensional ball of radius r in R”. 
Thus S,-1(r) = 9 


(r), and, taking account of (17.47), we obtain 


Qn 2 
Sn-1(7) = TO 
2 


n—-1 
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17.3.5 Problems and Exercises 


1. Show that 
a) B(1/2, 1/2) = 
b) Bia, 1—a) = fo? “da; 
c) 2B (a, B) = fy x11 — x8! nx de; 
d fo aitiy = FG) BER — PP: 
0) fo te = het 
) fo” i= al 
OY ia ee One <1): 
hy ft? oli Xdx = “ (-4-) 0 <a <1); 


i) the length of the curve defined in polar coordinates by the equation r” = 
a” cosn@, where n € N anda > 0, is aB(s, an): 


2. Show that 


a) M()=T (2); 

b) the derivative I’’ of I” is zero at some point xo € J1, 2[; 

c) the function I”’ is monotonically increasing on the interval ]0, +-oo[; 

d) the function I” is monotonically decreasing on ]0, xo] and monotonically in- 
creasing on [xo, +o0[; 

e) the integral i, (in yl InIn i du equals zero if x = x9; 

f) D(a) ~ 4 asa— +0; 

B) littn+oo fg ee * dx =1. 


n-1 
3. Euler’s formula E := [sy r() = ou 
a) Show that E? = ra PGES). 


b) Verify that E2 = —,——2— 


sin = sin27 -esin(n 4 


= —! =[Ti ee n ae let z tend to 1 to obtain 


and from this relation derive the relation 
n—-1 
kn 
n=2"-l sin —. 
I th 


d) Using this last equality, obtain Euler’s formula. 
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4. Legendre’s formula I (a) (a + 5) = SAT Qa). 

a) Show that B(a, a) = 2 fy/7(4 — 4 — x)2)"~! ax. 

b) By a change of variable in this last integral, prove that B(a,a) = 
sat B(5, a). 

c) Now obtain Legendre’s formula. 


5. Retaining the notation of Problem 5 of Sect. 17.1, show a route by which the sec- 
ond, more delicate part of the problem can be carried out using the Euler integrals. 


a) Observe that k=k fork= 77 and 


i m/2 1 2s m/2 dy 
f=2=[ 1 — =sin’ gdg, R=x= | —_——.. 
0 2 0 J1— sin? 


b) After a suitable change of variable these integrals can be brought into a form 
from which it follows that for k = 1/ J/2 


1 1 
K =——=B(1/4,1/2) and 2E — K =—=B(3/4, 1/2). 
Wel /2) an Wa /2) 


c) It now results that for k = 1//2 
EK+EK—KK =n/2. 


6. Raabe’s* integral ie In I(x) dx. 

Show that 
a) fo nr) dx = ff nr — x) de. 
b) fy nP(a)dx = Fin — 4 fl nsinx de. 
c) fo’? Insinx dx = fo"? Insin 2x dx — % In2. 
d) fo"? Insinx dx =—% In2. 


e) fy nI(x)dx =Inv2z. 
7. Using the equality 


1 1 as 
palgee / yo te dy 
xs I(s) Jo 


and justifying the reversal in the order of the corresponding integrations, verify that 


re : -1 
a) fh oe) cosax dx = be 


Ta 
ent ma (0<a <1). 


+00 sinb ppl 
a ee Oa 


2J.L. Raabe (1801-1859) — Swiss mathematician and physicist. 
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c) Now obtain once again the value of the Dirichlet integral Paes sina dx and 
the value of the Fresnel integrals io cos x7 dx and i sin x? dx. 


8. Show that for a > 1 


+00 xl 
/ dx = I'(a@)- f(a), 
0 ev — 1 


where €(a) = ye 1 4 is the Riemann zeta function. 


9. Gauss’ formula. In Example 6 of Sect. 16.3 we exhibited the function 


Raa tl) (@tn—DBB+1)-(B+n-l , 
Sa ny(y +) (yy tn—1 : 


’ 


n=1 


which was introduced by Gauss and is the sum of this hypergeometric series. It turns 
out that the following formula of Gauss holds: 


r(y)- Ty —a—B) 


POPYD =F oa). Fe =p) 


a) By developing the function (1 — tx)~* in a series, show that for w > 0, y- 
a > 0, and 0 < x < | the integral 


1 
P(x) = / Paar aaa 
0 


can be represented as 


(oe) 
PGl= Pek 
n=0 


B(B+1)--(B4+n—-1) | P@tn)-T(y-a@) 
n! P(y+n) . 


where P, = 
b) Show that 


- _LF@-Tyv-@ a@tl)---@tn—)sEt+):::GB+n—-b) 


_ ry) nly (y +1) (y+n—1) 
c) Now prove that fora > 0, y —a >0,and0<x <1 
T(a)-T(y —«@) 
P(x) = ——._———_: Fa, B, y, x). 
r(y) 


d) Under the additional condition y — a — B > 0 justify the possibility of passing 
to the limit as x — 1 — 0 on both sides of the last equality, and show that 


Pa): Py -a—Bb) _ P@)- Ty ~@) 
I'(y — B) ry) 


from which Gauss’ formula follows. 


Fa, B,y, 1), 
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10. Stirling’s* formula. Show that 


2m 


a) Inj#® =2x Oe for |x| <1; 


1 deena ae {i i 4 
b) @t+ s)Ind + D=1+ 3 qr + 5 Gat + 7aees tO 


c) 1<(n+5)In(1+ 4) <1+ pudgy forneN; 


ii 1 
d+, yt? el2n 
é < 


d) 1< 


1 ? 
el2m+l 
nie": , . 
jm+i7y 1S a monotonically decreasing sequence; 
1 
f) by =ane 12" is a monotonically increasing sequence; 


€) a, = 


An 
g) n!=cn"t!/2e"* Tan, where 0 < O, < 1, and c = limp—soo dn = lity soo by; 
h) the relation sinatx = 2x aie ;d-— «) with x = 1/2 implies Wallis’ formula 


a A 
va = lim, Qn)! Jn’ 


i) Stirling’s formula holds: 
n\" 6 
n= Vann“) el, O0<6, <1; 
e 


j) Pat) ~ v2rx(F)* as x > +00. 


11. Show that (x) = 7” 5 te : a + ii. t*—!e—' dt. This relation makes it 


possible to define /"(z) for complex z € C except at the points 0, —1, —2,.... 


17.4 Convolution of Functions and Elementary Facts 
About Generalized Functions 


17.4.1 Convolution in Physical Problems (Introductory 
Considerations) 


A variety of devices and systems in the living and nonliving natural world carry out 
their functions responding to a stimulus f with an appropriate signal i. . In other 
words, each such device or system is an operator A that transforms the incoming 
signal f into the outgoing signal if = Af. Naturally, each such operator has its own 
domain of perceivable signals (domain of definition) and its own form of response 
to them (range of values). A convenient mathematical model for a large class of 
actual processes and machines is a linear operator A that preserves translations. 


3y, Stirling (1692-1770) — Scottish mathematician. 
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Definition 1 Let A be a linear operator acting on a vector space of real- or complex- 
valued functions defined on R. We denote by 7; the shift operator or translation 
operator acting on the same space according to the rule 


(Ty f)() = f(t — to). 


The operator A is translation-invariant (or preserves translations) if 


A(T) f) = Tr (AP) 


for every function f in the domain of definition of the operator A. 


If ¢ is time, the relation A o T;, = Tj, o A can be interpreted as the assumption 
that the properties of the device A are time-invariant: the reaction of the device to 
the signals f(t) and f(t — fo) differ only in a shift by the amount fg in time, nothing 
more. 

For every device A the following two fundamental problems arise: first, to predict 
the reaction f of the device to an arbitrary input f; second, knowing the output 7, 
to determine, if possible, the input signal f. 

At this point we shall solve the first of these two problems heuristically in appli- 
cation to a translation-invariant linear operator A. It is a simple, but very important 
fact that in order to describe the response f of such a device A to any input signal 
f, it suffices to know the response E of A to a pulse 6. 


Definition 2 The response E(t) of the device A to a unit pulse 6 is called the system 
function of the device (in optics) or the transient pulse function of the device (in 
electrical engineering). 


As atule, we shall use the briefer term “system function”. 

Without going into detail just yet, we shall say that a pulse can be imitated, for 
example, by the function 6, (t) shown in Fig. 17.1, and this imitation is assumed to 
become closer as the duration a of the “pulse” gets shorter, preserving the relation 
a: + = |. Instead of step functions, one may imitate a pulse using smooth functions 
(Fig. 17.2) while preserving the natural conditions: 


Fa = 9, [ tearm, / fa(t)dt>1 asa—0, 
R U(0) 


where U (0) is an arbitrary neighborhood of the point t = 0. 

The response of the device A to an ideal unit pulse (denoted, following Dirac, 
by the letter 5) should be regarded as a function E(t) to which the response of the 
device A to an input approximating 6 tends as the imitation improves. Naturally a 
certain continuity of the operator A is assumed (not made precise as yet), that is, 
continuity of the change in the response i of the device under a continuous change 
in the input /f. 


446 17 Integrals Depending on a Parameter 


Fig. 17.1 
1 
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Fig. 17.2 
Fig. 17.3 


For example, if we take a sequence {A,,(¢)} of step functions A, (t) := 5) /n(t) 
(Fig. 17.1), then, setting AA, =: E,, we obtain Aé := E = limy+o En = 
limy—so0 AAn. 

Let us now consider the input signal f in Fig. 17.3 and the piecewise constant 
function /,(t) = ¥°; f (ti) dn(t — ti)h. Since I, > f as h > 0, one must assume 
that 


In = Aly > Af =f ash—O. 


But if the operator A is linear and preserves translates, then 
int) = 0 f(wEn@ — wh, 
i 
where E;, = Ad; Thus, as h > 0 we finally obtain 


fo=f f(t)E(t —t)dt. (17.48) 
R 


Formula (17.48) solves the first of the two problems indicated above. It represents 
the response f(t) of the device A in the form of a special integral depending on the 
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parameter ¢. This integral is completely determined by the input signal f(t) and 
the system function E(t) of the device A. From the mathematical point of view the 
device A and the integral (17.48) are simply identical. 

We note incidentally that the problem of determining the input signal from the 
output 7 now reduces to solving the integral equation (17.48) for f. 


Definition 3 The convolution of the functions u:R — C and v: R > C is the 
function u * v: R— C defined by the relation 


(u * v)(x) := [worve —y)dy, (17.49) 


provided this improper integral exists for all x € R. 


Thus formula (17.48) asserts that the response of a linear device A that preserves 
translates to an input given by the function f is the convolution f * E of the function 
f and the system function E of the device A. 


17.4.2 General Properties of Convolution 


Now let us consider the basic properties of convolution from a mathematical point 
of view. 


a. Sufficient Conditions for Existence 


We first recall certain definitions and notation. 

Let f :G— C be a real- or complex-valued function defined on an open set 
GCR. 

The function f is locally integrable on G if every point x € G has a neighbor- 
hood U(x) C G in which the function /|y(,) is integrable. In particular, if G = R, 
the condition of local integrability of the function f is obviously equivalent to the 
relation f |[a,p) € Ra, b] for every closed interval [a, b]. 

The support of the function f (denoted supp f) is the closure in G of the set 
{xeG| f(x) #0}. 

A function f is of compact support (in G) if its support is a compact set. 

The set of functions f : G — C having continuous derivatives in G up to order m 
(0 <m < ov) inclusive, is usually denoted C (™)(G) and the subset of it consisting of 
functions of compact support is denoted ca). In the case when G = R, instead 


of CR) and ce (R) it is customary to use the abbreviation C’”) and cm 
respectively. 

We now exhibit the most frequently encountered cases of convolution of func- 
tions, in which its existence can be established without difficulty. 
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Proposition 1 Each of the conditions listed below is sufficient for the existence of 
the convolution u * v of locally integrable functions u: R—> C andv:R—- C. 


1) The functions |u|? and |v|? are integrable on R. 
2) One of the functions |u|, |v| is integrable on R and the other is bounded on R. 
3) One of the functions u and v is of compact support. 


Proof 1) By the Cauchy—Bunyakovskii inequality 


2 
([|moree - »]ay) <[ uPody | lvl2(x — yay, 
R R R 


from which it follows that the integral (17.49) exists, since 


+oo +oo 
i Il? — y) dy Sf Ivl2() dy. 


2) If, for example, |u| is integrable on R and |v| < M on R, then 


[wore »ylay sam f lul(y) dy < +00. 
R R 


3) Suppose suppu C [a, b] C R. Then obviously 


b 


[wore - aye f u(y)v(x — y) dy. 


a 
Since u and v are locally integrable, this last integral exists for every value of 
xeR. 


The case when the function of compact support is v reduces to the one just con- 
sidered by the change of variable x — y = z. 


b. Symmetry 


Proposition 2 [f the convolution u x v exists, then the convolution v * u also exists, 
and the following equality holds: 


UXV=VREU. (17.50) 


Proof Making the change of variable x — y = z in (17.49), we obtain 


+00 Oo 
u* v(x) =] u(y y)dy= f v(z)u(x — z)dz=:v * u(x). 


[o,@) [o,e) 
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c. Translation Invariance 
Suppose, as above, that 7;, is the shift operator, that is, (T;,) f(x) = f(x — x0). 


Proposition 3 [f the convolution u * v of the functions u and v exists, then the 
following equalities hold: 


Ty (U * V) = Ty * U =U * Ty v. (17.51) 


Proof Vf we recall the physical meaning of formula (17.48), the first of these equal- 
ities becomes obvious, and the second can then be obtained from the symmetry of 
convolution. Nevertheless, let us give a formal verification of the first equality: 


(Trp) (u * v)(X) = (CU * U)(x — X0) = 


+00 +o0o0 
Saf u(y) —x0= yay = f u(y — xo)u(x — y)dy = 


—oo —oo 


+00 
. / (Tea) (yu — y) dy =: (Leg) * v)(x). 


—co 


d. Differentiation of a Convolution 


The convolution of functions is an integral depending on a parameter, and differen- 
tiation of it can be carried out in accordance with the general rules for differentiating 
such integrals, provided of course suitable hypotheses hold. 

The conditions under which the convolution (17.49) of the functions u and v is 
continuously differentiable are demonstrably satisfied if, for example, u is continu- 
ous and v is a smooth function and one of the two is of compact support. 


Proof Indeed, if we confine the variation of the parameter to any finite interval, then 
under these hypotheses the entire integral (17.49) reduces to the integral over a finite 
closed interval independent of x. Such an integral can be differentiated with respect 
to a parameter in accordance with the classical rule of Leibniz. 


In general the following proposition holds: 


Proposition 4 [fu is a locally integrable function and v is a ce function of com- 
pact support (0 <m < +00), then (u*v) € Cc, and* 


D*(u xv) =u * (D*v). (17.52) 


“Here D is differentiation, and, as usual D‘v =v. 
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Proof When u is a continuous function, the proposition follows immediately from 
what was just proved above. In its general form it can be obtained if we also keep in 
mind the observation made in Problem 6 of Sect. 17.1. 


Remark 1 In view of the commutativity of convolution (formula (17.50)) Proposi- 
tion 4 of course remains valid if u and v are interchanged, preserving the left-hand 
side of Eq. (17.52). 

Formula (17.52) shows that convolution commutes with the differentiation op- 
erator, just as it commutes with translation (formula (17.51)). But while (17.51) is 
symmetric in u and v, one cannot in general interchange u and v in the right-hand 
side of (17.52), since u may fail to have the corresponding derivative. The fact that 
the convolution u *« v, as one can see by (17.52), may still turn out to be a differ- 
entiable function, might suggest that the hypotheses of Proposition 4 are sufficient, 
but not necessary for differentiability of the convolution. 


Example I Let f be a locally integrable function and dy the “step” function shown 
in Fig. 17.1. Then 


+o0o 1 x. 
(f *Sa)@) = / FO)baCe = y)dy = = / f(y) dy, (17.53) 


and consequently if f is continuous at the points x and x — a, then the convolution 
Ff * 5q is differentiable, due to the averaging (smoothing) property of the integral. 


The conditions for differentiability of the convolution stated in Proposition 4 are, 
however, completely sufficient for practically all the cases one encounters in which 
formula (17.52) is applied. For that reason we shall not attempt to refine them any 
further, preferring to illustrate some beautiful new possibilities that open up as a 
result of the smoothing action of convolution just discovered. 


17.4.3, Approximate Identities and the Weierstrass Approximation 
Theorem 


We remark that the integral in (17.53) gives the average value of the function 
f on the interval [x — a,x], and therefore, if f is continuous at x, the relation 
(f * }dq)(x) > f(x) obviously holds as a — 0. In accordance with the introductory 
considerations of Sect. 17.4.1 that gave a picture of the 6-function, we would like to 
write this last relation as the limiting equality 


(f *d)(x) = f(x), if f is continuous at x. (17.54) 


This equality shows that the 5-function can be interpreted as the identity (neu- 
tral) element with respect to convolution. Equality (17.54) can be regarded as mak- 
ing perfect sense if it is shown that every family of functions converging to the 
5-function has the same property as the special family d, of (17.53). 
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Let us now pass to precise statements and introduce the following useful defini- 
tion. 


Definition 4 The family {Aq; a € A} of functions Ag : R > R depending on the 
parameter a € A forms an approximate identity over a base B in A if the following 
three conditions hold: 


a) all the functions in the family are nonnegative (Ag > 0); 
b) for every function Ag in the family, te Ag (x) dx = 1; 
c) for every neighborhood U of 0 € R, limg Af y Aa(x) dx = 1. 


Taking account of the first two conditions, we see that this last condition is equiv- 
alent to the relation limg fp, Aa (x) dx =0. 

The original family of “step” functions 6, considered in Example | of Sect. 17.4.1 
is an approximate identity as @ — 0. We shall now give other examples of approxi- 
mate identities. 


Example 2 Let gy : R > R be an arbitrary nonnegative function of compact support 
that is integrable over R and satisfies ie g(x) dx = 1. For a > 0 we construct the 


functions Ag (x) := +9(2). The family of these functions is obviously an approxi- 
mate identity as ~w > +0 (see Fig. 17.2). 


Example 3 Consider the sequence of functions 


(1—x?)" 
An(x) = 4 Sic -2°" dx 
0 for |x| > 1. 


for |x| < 1, 


To establish that this family is an approximate identity we need only verify that 
condition c) of Definition 4 holds in addition to a) and b). But for every ¢ € ]0, 1] 
we have 


1 1 
o</ (1-2y'ax sf (1—e*)"dx= 
éE é 


=(1—-«7)"(l-«) > 0, asn—> oo. 


At the same time, 


1 1 
1 
/ (1 — x7)" dx ah (1 — x)" dx = ——. 
0 0 n+ 1 
Therefore condition c) holds. 


Example 4 Let 


2n 1/2 2n d f < 2 
Keyes cos (x)/ [ri cos*"(x)dx for |x| < 2/2, 
0) for |x| > 7/2. 
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As in Example 3, it remains only to verify condition c) here. We remark first of 
all that 


ae 1 (4\ ireat2 r@. red 
i cos"" x dx = —B(n+ : = (n in) ; (3) _ () 
n 2 2°27 2 Fi) n 2n 


On the other hand, for ¢ € ]0, 2 /2[ 
m/2 u/2 
/ cos” x dx < / cos”” edx < 5 (cos ey. 
E Lou 


Combining the two inequalities just obtained, we conclude that for every ¢ € 
]0, «/2], 


m/2 
i An(x)dx ~ 0 asn>w, 
& 
from which it follows that condition c) of Definition 4 holds. 


Definition 5 The function f : G— C is uniformly continuous on the set E C G if 
for every ¢ > 0 there exists p > 0 such that | f(x) — f(y)| < e for every x € E and 
every y € G belonging to the p-neighborhood Ue (x) of x in G. 


In particular, if E = G we simply get back the definition of a function that is 
uniformly continuous on its entire domain of definition. 
We now prove a fundamental proposition. 


Proposition 5 Let f : R— C be a bounded function and {Aq; a € A} an approx- 
imate identity as a —> w. If the convolution f * Aq exists for every a € A and the 
function f is uniformly continuous on the set E CR, then 


(f * Ay)(x) 3 f(x) on Easa>a. 


Thus it is asserted that the family of functions f * Ag converges uniformly to 
f ona set E on which it is uniformly continuous. In particular, if E consists of 
only one point, the condition of uniform continuity of f on E reduces to the con- 
dition that f be continuous at x, and we find that (f * Ag)(x) > f(x) asa —> o. 
Previously this fact served as our motivation for writing relation (17.54). 

Let us now prove Proposition 5. 


Proof Suppose | f(x)| < M on R. Given a number ¢ > 0, we choose p > 0 in ac- 
cordance with Definition 5 and denote the p-neighborhood of 0 in R by U(0). 

Taking account of the symmetry of convolution, we obtain the following two 
estimates, which hold simultaneously for all x € E: 
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I(f * Aw)(x) — fa) 


= [[ fe -naeorar— f(x) 


= 


7 [ve — y) — f@)) Aa) dy 


<|[ [P= y) — For|daoray + f |f@ — y) — f@)|Aa(y) dy < 
U(0) R\U(O) 


<e| Aaty)dy 2m f Aay)dy se-+2M [ Aq(y) dy. 
U(O) R\U(0) R\U(0) 
As a — a, this last integral tends to zero, so that the inequality 


[Cf * Aa)(x) — f (x)| < 2e 


holds for all x € E from some point a, on. This completes the proof of Proposi- 
tion 5. 


Corollary 1 Every continuous function of compact support on R can be uniformly 
approximated by infinitely differentiable functions. 


Proof Let verify that C - is everywhere dense in Co in this sense. 
We let, for example, 


k-exp(-— for <i, 
oo={' p(-7-42)_ for|a| 


1—x? 
for |x| > 1, 


where k is chosen so that tr g(x)dx = 1. 

The function g is of compact support and infinitely differentiable. In that case, 
the family of infinitely differentiable functions Ay = >9(2), as observed in Exam- 
ple 2, is an approximate identity as a > +0. If f € Co, itis clear that f * Ay € Co. 
Moreover, by Proposition 4 we have f * Ag € Co°. Finally, it follows from Propo- 
sition 5 that f * Ay = f on Rasa — +0. 


Remark 2 If the function f € Co belongs to Ce. then for every value n € 
{0, 1,...,m} we can guarantee that (f * Ay)” = f™ on Ras a — +0. 


Proof Indeed, in this case (f * Ay)” = f™ * Ay (see Proposition 4 and Re- 
mark 1). All that now remains is to cite Corollary 1. 


Corollary 2 (The Weierstrass approximation theorem) Every continuous function 
on a closed interval can be uniformly approximated on that interval by an algebraic 
polynomial. 
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Proof Since polynomials map to polynomials under a linear change of variable 
while the continuity and uniformity of the approximation of functions are preserved, 
it suffices to verify Corollary 2 on any convenient interval [a, b] C R. For that rea- 
son we shall assume 0 < a < b < 1. We continue the given function f € C[a, b] to 
a function F that is continuous on R by setting F(x) = 0 for x € R\]0, 1[ and, for 
example, letting F be a linear function going from 0 to f(a) and from f(b) to 0 on 
the intervals [0, a] and [b, 1] respectively. 

If we now take the approximate identity consisting of the functions A, of Exam- 
ple 3, we can conclude from Proposition 5 that F * A, = f = F|fa,p] on [a, b] as 
n— oo. But for x € [a, b] c [0, 1] and y € [0, 1] we have |x — y| < 1, therefore 


lee) 1 
F * An(x) =| F(y)An(x ~y)dy= f F(y)An(x — y)dy = 


1 1 2n 
= i F(y)pn- (1— (x — y)”)" dy =| ro au dy = 


k=0 


2n 1 
. pa i F(y)ae(y) ay) 
k=0 “9 


This last expression is a polynomial P2, (x) of degree 2n and we have shown that 
Po, = f on [a,b] asn > oo. 


Remark 3 By aslight extension of this reasoning one can show that Weierstrass the- 
orem remains valid if the interval [a, b] is replaced by an arbitrary compact subset 
of R. 


Remark 4 It is also not difficult to verify that for every open set G in R and every 
function f € C")(G) there exists a sequence { P;} of polynomials such that pe = 
f™ onevery compact set K C G for each n € {0, 1,.. .,m} as k — oo. 

If in addition the set G is bounded and f € C(G), then one can even get 
pe = f™ onGask— oo. 


Remark 5 Just as the approximate identity of Example 3 was used in the proof of 
Corollary 2, one can use the sequence from Example 4 to prove that every 27- 
periodic function on R can be uniformly approximated by trigonometric polynomi- 
als of the form 


n 
Tn(x) = So ax coskx + by sinkx. 
k=0 
We have used only approximate identities made up of functions of compact sup- 
port above. However, it should be kept in mind that approximate identities of func- 
tions that are not of compact support play an important role in many cases. We shall 
give only two examples. 
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Example 5 The family of functions A, (x) = erect is an approximate identity on 


Ras y > +0, since Ay > 0 for y > 0, 


lee) 1 x +00 
j. Ay(x)dx = = arctan(*) =1, 
—0o . ss y x=-—0O 
and for every p > 0 we have 
p 2 p 
Ay(x) dx = —arctan— —> 1, 
a cd y 
when y > +0. 
If f : R > Ris a bounded continuous function, then the function 
1 [o,@) 
u(x, y) = | sue (17.55) 
MT Joo (X—§) +y 


which is the convolution f * Ay, is defined for all x € R and y > 0. 

As one can easily verify using the Weierstrass M-test, the integral (17.55), which 
is called the Poisson integral for the half-plane, is a bounded infinitely differentiable 
function in the half-plane Ry = {(x, y) € R? | y > 0}. Differentiating it under the 
integral sign, we verify that for y > 0 


A a7u Ss a7 u ¥ a? 4 a? A 0 
“ui: —_ = * — — » =U, 
ax2 dy? ax2  ay2)°” 


that is, u is a harmonic function. 


By Proposition 5 one can also guarantee that u(x, y) converges to f(x) as y > 0. 
Thus, the integral (17.55) solves the problem of constructing a bounded function 
that is harmonic in the half-plane Ry and assumes prescribed boundary values f on 


aR. 


2 
Example 6 The family of functions A; = ware is an approximate identity 
on R as t — +0. Indeed, we certainly have A; > 0 and (oe A;(x) = 1, since 


i by e dy= ./m (the Euler—Poisson integral). Finally, for every p > 0 we have 


[ 1 2 1 p/2/t 2 

ae ta-—/ e’ dv—-1l, ast— +0. 

-p 2/1 t Jt —p/2/t 

If f is a continuous and, for example, bounded function on R, then the function 


(x= 


a dé, (17.56) 


u(x,t) = 


1 +00 = 
a [ _ fee 


which is the convolution f *« A;, is obviously infinitely differentiable for t > 0. 
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By differentiating under the integral sign for t > 0, we find that 


du du a 
weet 7) 410 


that is, the function wu satisfies the one-dimensional heat equation with the initial 
condition u(x,0) = f(x). This last equality should be interpreted as the limiting 
relation u(x,t) > f(x) as t ~ +0, which follows from Proposition 5. 


17.4.4 *Elementary Concepts Involving Distributions 


a. Definition of Generalized Functions 


In Sect. 17.4.1 of this section we derived the formula (17.48) on the heuristic level. 
This equation enabled us to determine the response of a linear transformation A 
to an input signal f given that we know the system function E of the device A. 
In determining the system function of a device we made essential use of a certain 
intuitive idea of a unit pulse action and the 6-function that describes it. It is clear, 
however, that the 5-function is really not a function in the classical sense of the term, 
since it must have the following properties, which contradict the classical point of 
view: 6(x) > 0 on R; 6(x) = 0 for x £0, Jp 5(X) dx = 1. 

The concepts connected with linear operators, convolution, the 5-function, and 
the system function of a device acquire a precise mathematical description in the 
so-called theory of generalized functions or the theory of distributions. We are now 
going to explain the basic principles and the elementary, but ever more widely used 
techniques of this theory. 


Example 7 Consider a point mass m that can move along the axis and is attached to 
one end of an elastic spring whose other end is fixed at the origin; let k be the elastic 
constant of the spring. Suppose that a time-dependent force f(t) begins to act on 
the point resting at the origin, moving it along the axis. By Newton’s law, 


mi +kx = f, (17.57) 


where x(t) is the coordinate of the point (its displacement from its equilibrium po- 
sition) at time f. 

Under these conditions the function x(f) is uniquely determined by the func- 
tion f, and the solution x(t) of the differential equation (17.57) is obviously a 
linear function of the right-hand side f. Thus we are dealing with the linear op- 


erator f —s x inverse to the differential operator x ey f (where B = m4, +k) 
that connects x(t) and f(t) by the relation Bx = f. Since the operator A obviously 
commutes with translations over time, it follows from (17.48) that in order to find 
the response x(t) of this mechanical system to the function f(t), it suffices to find 
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its response to a unit pulse 4, that is, it suffices to know the so-called fundamental 
solution E of the equation 


mE+kE=6. (17.58) 


Relation (17.58) would not raise any problems if 6 actually denoted a function. 
However Eq. (17.58) is not yet clear. But being formally unclear is quite a differ- 
ent thing from being actually false. In the present case one need only explain the 
meaning of (17.58). 

One route to such an explanation is already familiar to us: we can interpret 6 
as an approximate identity imitating the delta-function and consisting of classical 
functions A(t); we interpret E as the limit to which the solution E,(t) of the 
equation 


mEy + kEy = Ay (17.57) 


tends as the parameter a changes suitably. 

A second approach to this problem, one that has significant advantages, is to 
make a fundamental enlargement of the idea of a function. It proceeds from the 
remark that in general objects of observation are characterized by their interaction 
with other (“test”) objects. Thus we propose regarding a function not as a set of 
values at different points, but rather as an object that can act on other (test) objects 
in a certain manner. Let us try to make this statement, which as of now is too general, 
more specific. 


Example 8 Let f € C(R, R). As our test functions, we choose functions in Co (con- 
tinuous functions of compact support on R). A function f generates the following 
functional, which acts on Co: 


(fh) = [ F(x)o(x) de. (1759) 


Using approximate identities consisting of functions of compact support, one can 
easily see that ( f, gy) = 0 on Co if and only if f(x) =0 on R. 

Thus, each function f € C(R,R) generates via (17.59) a linear functional 
Af :Co — R and, we emphasize, different functionals As, and A, correspond 
to different functions f; and fo. 

Hence formula (17.59) establishes an embedding (injective mapping) of the set 
of functions C(R, R) into the set £(Co; R) of linear functionals on Co, and con- 
sequently every function f € C(R,R) can be interpreted as a certain functional 
Af €L£(Co; R). 

If we consider the class of locally integrable functions on R instead of the set 
C(R, R) of continuous functions, we obtain by the same formula (17.59) a mapping 
of this set into the space £(Co; R). Moreover (( f, ¢) =0 on Co) > (f(x) = Oat all 
points of continuity of f on R, that is, f(x) = 0 almost everywhere on R). Hence in 
this case we obtain an embedding of equivalence classes of functions into £(Co; R) 
if each equivalence class contains locally integrable functions that differ only on a 
set of measure zero. 
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Thus, the locally integrable functions f on R (more precisely, equivalence 
classes of such functions) can be interpreted via (17.59) as linear functionals 
Ar €£(Co; R). The mapping f +> Ay = (f,-) provided by (17.59) of locally in- 
tegrable functions into £(Co; R) is not a mapping onto all of £(Co; R). Therefore, 
interpreting functions as elements of £(Co; R) (that is, as functionals) we obtain, 
besides the classical functions interpreted as functionals of the form (17.59), also 
new functions (functionals) that have no pre-image in the classical functions. 


Example 9 The functional 5 € £(Co; R) is defined by the relation 


(5, @) :=48(g) := g(0), (17.60) 


which must hold for every function g € Co. 

We can verify (see Problem 7) that no locally integrable function f on R can 
represent the functional 6 in the form (17.59). 

Thus we have embedded the set of classical locally integrable functions into a 
larger set of linear functionals. These linear functionals are called generalized func- 
tions or distributions (a precise definition is given below). The widely used term 
“distribution” has its origin in physics. 


Example 10 Suppose a unit mass (or unit charge) is distributed on R. If this dis- 
tribution is sufficiently regular, in the sense that it has, for example, a continuous 
or integrable density o(x) on R, the interaction of the mass M with other objects 
described by functions go € ce can be defined as a functional 


M(g) = [ ecovorar. 


If the distribution is singular, for example, the whole mass M is concentrated at a 
single point, then by “smearing” the mass and interpreting the limiting point situ- 
ation using an approximate identity made up of regular distributions, we find that 
the interaction of the mass M with the other objects mentioned above should be 
expressed by a formula 


M(¢)=¢(0), 


which shows that such a mass distribution on R should be identified with the 6- 
function (17.60) on R. 


These preliminary considerations give some sense to the following general defi- 
nition. 


Definition 6 Let P be a vector space of functions, which will be called the space of 
test functions from now on, on which there is defined a notion of convergence. 

The space of generalized functions or distributions on P is the vector space P’ 
of continuous (real- or complex-valued) linear functionals on P. Here it is assumed 
that each element f € P generates a certain functional A ¢ = (f, -) € P’ and that the 
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mapping f +> A+ is a continuous embedding of P into P’ if the convergence in P’ 
is introduced as weak (“pointwise”) convergence of functionals, that is, 


P'3A,7>A€EP':=VoEP (An (v) > A(g)). 


Let us make this definition more precise in the particular case when P is the 


vector space COG, C) of infinitely differentiable functions of compact support 
in G, where G is an arbitrary open subset of R (possibly R itself). 


Definition 7 (The spaces D and D’) We introduce convergence in CG, C) as 


follows: A sequence {g,} of functions g, € CPG) converges to y € ce (G, C) 
if there exists a compact set K C G that contains the supports of all the functions of 
the sequence {g,} and of” = g™ on K (and hence also on G) as n > oo for all 
m=0,1,2,.... 

The vector space obtained in this way with this convergence is usually denoted 
D(G), and when G = R, simply D. 

We denote the space of generalized functions (distributions) corresponding to 
this space of basic (test) functions by D’(G) or D’ respectively. 


In this section and the one following we shall not consider any generalized func- 
tions other than the elements of D’(G) just introduced. For that reason we shall use 
the term distribution or generalized function to refer to elements of D’(G) without 
saying so explicitly. 


Definition 8 A distribution F € D'(G) is regular if it can be represented as 


F@)= a fx)ex)dx, geD(G), 


where /f is a locally integrable function in G. 
Nonregular distributions will be called singular distributions or singular gener- 
alized functions. 


In accordance with this definition the 5-function of Example 9 is a singular gen- 
eralized function. 

The action of a generalized function (distribution) F' on a test function ¢, that 
is, the pairing of F and ¢ will be denoted, as before, by either of the equivalent 
expressions F'(g) or (F, ¢@). 

Before passing to the technical machinery connected with generalized functions, 
which was our motive for defining them, we note that the concept of a general- 
ized function, like the majority of mathematical concepts, had a certain period of 
gestation, during which it developed implicitly in the work of a number of mathe- 
maticians. 

Physicists, following Dirac, made active use of the 5-function as early as the late 
1920s and early 1930s and operated with singular generalized functions without 
worrying about the absence of the necessary mathematical theory. 
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The idea of a generalized function was stated explicitly by S.L. Sobolev,” who 
laid the mathematical foundations of the theory of generalized functions in the mid- 
1930s. The current state of the machinery of the theory of distributions was largely 
the work of L. Schwartz.° What has just been said explains why, for example, the 
space D’ of generalized functions is often referred to as the Sobolev-Schwartz space 
of generalized functions. 

We shall now explain certain elements of the machinery of the theory of dis- 
tributions. The development and extension of the use of this machinery continues 
even today, mainly in connection with the requirements of the theory of differen- 
tial equations, the equations of mathematical physics, functional analysis, and their 
applications. 

To simplify the notation we shall consider below only generalized functions in 
D’, although all of their properties, as will be seen from their definitions and proofs, 
remain valid for distributions of any class D’(G), where G is an arbitrary open 
subset of R. 

Operations with distributions are defined by starting with the integral relations 
that are valid for classical functions, that is, for regular generalized functions. 


b. Multiplication of a Distribution by a Function 


If f is a locally integrable function on R and g € C), then for any function y € 
ee , on the one hand gg € cn and, on the other hand, we have the obvious 
equality 


a (F  g)Q)e(x) dx = ia FO (g p(x) dx 
or, in other notation 


This relation, which is valid for regular generalized functions, provides the basis 
for the following definition of the distribution F - g obtained by multiplying the 
distribution F € D’ by the function g € C®?: 


(F- 9,9) :=(F,8-¢). (17.61) 


The right-hand side of Eq. (17.61) is defined, and thus defines the value of the 
functional F - g on any function g € D, that is, the functional F - g itself is defined. 


5§.L. Sobolev (1908-1989) — one of the most prominent Soviet mathematicians. 


61. Schwartz (1915-2002) — well-known French mathematician. He was awarded the Fields medal, 
a prize for young mathematicians, at the International Congress of Mathematicians in 1950 for the 
above mentioned work. 
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Example 11 Let us see how the distribution 6 - g acts, where g € C/®). In accor- 
dance with the definition (17.61) and the definition of 6, we obtain 


(8-2, 9) := (5, 8-9) :=(g-9)(0) = g(0)- (0). 


c. Differentiation of Generalized Functions 


If f eC and ge oe , integration by parts yields the equality 


[ roomar=- [ roe war. (17.62) 


This equality is the point of departure for the following fundamental definition 
of differentiation of a generalized function F € D’: 


(F’, 9) :=—(F, ¢’). (17.63) 


Example 12 If f ¢ C\, the derivative of f in the classical sense equals its deriva- 
tive in the distribution sense (provided, naturally, the classical function is identified 
with the regular generalized function corresponding to it). This follows from a com- 
parison of relations (17.62) and (17.63), in which the right-hand sides are equal if 
the distribution F is generated by the function f/f. 


Example 13 Take the Heaviside’ function 


0 forx <0, 
a {{ for x > 0, 


sometimes called the unit step. Regarding it as a generalized function, let us find the 
derivative H’ of this function, which is discontinuous in the classical sense. 


From the definition of the regular generalized function H corresponding to the 
Heaviside function and relation (17.63) we find 


+00 +00 
(H’, o):=—(H, p'}:= — i H(x)g"(x) dx = [ y (x) dx = 9(0), 


since g € Co Thus (H’, v) = (6, g), for every function g € c. Hence H'’=6. 
Example 14 Let us compute (6’, ¢): 


(8, g) := —(8, g') = —¢'(0). 


70. Heaviside (1850-1925) — British physicist and engineer, who developed on the symbolic level 
the important mathematical machinery known as the operational calculus. 
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It is natural that in the theory of generalized functions, as in the theory of classical 
functions, the higher-order derivatives are defined by setting F+) := (F™Y’. 
Comparing the results of the last two examples, one can consequently write 


(H”, ~)=—g'(0). 
Example 15 Let us show that (6, g) = (—1)"9™ (0). 


Proof For n = 0 this is the definition of the 5-function. 

We have seen in Example 14 that this equality holds for n = 1. 

We now prove it by induction, assuming that it has been established for a fixed 
value n € N. Using definition (17.63), we find 


(8°, g) = (BY. 9) = (8, 9) = 


= =(-1)"(¢') (0) = (-1)"t1g™ Do). 


Example 16 Suppose the function f : R > C is continuously differentiable for 
x <0 and for x > 0, and suppose the one-sided limits f(—0) and f(+0) of the 
function exist at 0. We denote the quantity f(+0) — f(—0), the saltus or jump of 
the function at 0, by J f(0), and by f’ and {f’} respectively the derivative of f in 
the distribution sense and the distribution defined by the function equal to the usual 
derivative of f for x <0 and x > 0. At x = 0 this last function is not defined, but 
that is not important for the integral through which it defines the regular distribu- 
tion { f’}. 

In Example 12 we noted that if f ¢ C“, then f’ = { f’}. We shall show that in 
general this is not the case, but rather the following important formula holds: 


f ={f}+IFO)-6. (17.64) 


Proof Indeed, 
+00 


-(f,¢')=- f(x)" (x) dx = 


-(f+ [yu (x)y"(x)) dx = 


0 
-((F -p(x)) [o_o -{ f’ (g(a) dx + (Ff -p)O)|o° — 


(f',¢) 


+00 


a f'(a)(s) dr) = 


+00 


(f (+0) — f(—0)) 9) + f' (x) g(x) dx = 


=(ffO)-4,9)+({F'}. 9)- 
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If all derivatives up to order m of the function f : R — C exist on the intervals 
x <0 and x > 0, and they are continuous and have one-sided limits at x = 0, then, 
repeating the reasoning used to derive (17.64), we obtain 


fm = {fo} EPO) oY + (POs ae 
reed [ FO" OO) mS (17.65) 


We now exhibit some properties of the operation of differentiation of generalized 
functions. 


Proposition 6 a) Every generalized function F € D’ is infinitely differentiable. 
b) The differentiation operation D:D’! + D' is linear. 
c) If F €D! and g € C®), then (F - g) € D’, and the Leibniz formula holds: 


m 
m ax 
(F-gy™ axe ) Fe gm ib) 
k=0 


d) The differentiation operation D:D’ + D’ is continuous. 

e) If the series °°, f(x) = S(x) formed from locally integrable functions 
Si: R > C converges uniformly on each compact subset of R, then it can be dif- 
ferentiated termwise any number of times in the sense of generalized functions, and 
the series so obtained will converge in D'. 


Proof a) (F™, 9) := (FO), 9!) = (-1)"(F, 9). 
b) Obvious. 
c) Let us verify the formula for m = 1: 


(F-8)',¢):=—-(Fg,¢'):=—-(F.g-¢')=—-(F.(g-9)'-8'-g)= 
= (F’,g9)+(F,8'-9)=(F’- 8,9) +(F-8. 9) =(F'-g+F-8',9). 
In the general case we can obtain the formula by induction. 


d) Let Fn — F in D’ as m > o, that is, for every function g € D( Fin, y) > 
(F,g) asm — oo. Then 


(Fj, 9) = —(Fm, ¢') > -(F, 9) =:(F', 9). 


e) Under these conditions the sum S(x) of the series, being the uniform limit 
of locally integrable functions Sj,(x) = )-¢_, fe(x) on compact sets, is locally in- 
tegrable. It remains to observe that for every function g € D (that is, of compact 


support and infinitely differentiable) we have the relation 


(Sia a Sin (X00) dx > i Souda Sol 


We now conclude on the basis of what was proved in d) that S’, > S’ asm — oo. 


464 17 Integrals Depending on a Parameter 


We see that the operation of differentiation of generalized functions retains the 
most important properties of classical differentiation while acquiring a number of 
remarkable new properties that open up a great deal of freedom of operation, which 
did not exist in the classical case because of the presence of nondifferentiable func- 
tions there and the instability (lack of continuity) of classical differentiation under 
limiting processes. 


d. Fundamental Solutions and Convolution 


We began this subsection with intuitive ideas of the unit pulse and the system func- 
tion of the device. In Example 7 we exhibited an elementary mechanical system that 
naturally generates a linear operator preserving time shifts. Studying it, we arrived 
at Eq. (17.58), which the system function E of that operator must satisfy. 

We shall conclude this subsection by returning once again to these questions, 
but now with the goal of illustrating an adequate mathematical description in the 
language of generalized functions. 

We begin by making sense of Eq. (17.58). On its right-hand side is the gen- 
eralized function 6, so that relation (17.58) should be interpreted as equality of 
generalized functions. Since we know the operations of differentiating generalized 
functions and linear operations on distributions, it follows that the left-hand side of 
Eq. (17.58) is now also comprehensible, even if interpreted in the sense of general- 
ized functions. 

Let us now attempt to solve Eq. (17.58). 

At times t < 0 the system was in a state of rest. At t = 0 the point received a unit 
pulse, thereby acquiring a velocity v = v(0) such that mv = 1. For t > O there are 
no external forces acting on the system, and its law of motion x = x(t) is subject to 
the usual differential equation 


mi +kx =0, (17.66) 


which are to be solved with the initial conditions x(0) = 0, x(0) =v=1/m. 
Such a solution is unique and can be written out immediately: 


1 . [fk 
sin,/—t, t>0. 
km m 


Since in the present case the system is at rest for t < 0, we can conclude that 


B= BO sin Er, reR, (17.67) 


where H is the Heaviside function (see Example 13). 

Let us now verify, using the rules for differentiating generalized functions and the 
results of the examples studied above, that the function E(t) defined by Eq. (17.67) 
satisfies Eq. (17.58). 


x(t) = 
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To simplify the writing we shall verify that the function 


sin Wx 


e(x) = H(x) (17.68) 


@ 


satisfies (in the sense of distribution theory) the equation 


d? ; 
(te Jems (17.69) 


Indeed, 


a ‘ _ d2 yy inex jg yy Sox - 
dx2 . <= dee ) e ) ~ 


sin 
+ wH (x) sinwx = gi SON 4 28 coswx. 
@ 


Further, for every function g € D, 


, Sin @x , sin@x 
eae = rere 2 + (5, 2(cos wx)g) = 


d /sinwx 
=, ( v)}+290)= 
dx w 


= (eos wox)g(x) + mer g(a) 


+29(0) = 
x=0 


= 90) = (5, 9), 


and it is thereby verified that the function (17.68) satisfies (17.69). 
Finally, we introduce the following definition. 


Definition 9 A fundamental solution or Green’s function (system function or influ- 
ence function) of the operator A : D’ — D’ is a generalized function E € D’ that is 
mapped by A to the function 6 € D’, that is, A(E) =6. 


Example 17 In accordance with this definition the function (17.68) is a fundamental 
solution for the operator A = (4 + w”), since it satisfies (17.69). 

The function (17.67) satisfies Eq. (17.58), that is, it is a Green’s function for 
the operator A = m4, +k). The fundamental role of the system function of a 
translation-invariant operator has already been discussed in Sect. 17.4.1, where for- 
mula (17.48) was obtained, on the basis of which one can now write the solution of 
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Eq. (17.57) corresponding to the initial conditions given in Example 7: 


+00 sin [Er 
= E = — t)H(t) —- d 17.7 
x(t) = (f * E)(t) [. f(t— t)H(t) Jun T, (17.70) 


+00 
x(t) = wail fe nsiny Arar. (17.71) 


When we take account of the important role of the convolution and the funda- 
mental solution just illustrated, it becomes clear that it is desirable to define the 
convolution of generalized functions also. This is done in the theory of distribu- 
tions, but we shall not take the time to do so. We note only that in the case of regular 
distributions the definition of the convolution of generalized functions is equivalent 
to the classical definition of the convolution of functions studied above. 


17.4.5 Problems and Exercises 


1. a) Verify that convolution is associative: u * (v * w) = (u* v) * Ww. 
b) Suppose, as always, that I”(q~) is the Euler gamma function and H (x) is the 


Heaviside function. We set 
xe! 


I'(a) 


Hy (x) := A(x) e’*, wherea>0, andreC. 
Show that Hy « HP = ae 
c) Verify that the function F = H(x) ae is the nth convolution power of 
f =H (x)e™, that is, F = fx fx---* f. 
$< 


n 


2. The function Gg (x) = = Tee 202 , o > 0, defines the probability density func- 
tion for the Gaussian normal distribution. 

a) Draw the graph of G, (x) for different values of the parameter o. 

b) Verify that the mathematical expectation (mean value) of a random variable 
with the probability distribution G, is zero, that is, i xGo(x)dx =0. 

c) Verify that the standard deviation of x (the square root of the variance of x) 
is o, that is (fp x7Go(x)dx)!/* =o. 

d) Itis proved in probability theory that the probability density of the sum of two 
independent random variables is the convolution of the densities of the individual 
variables. Verify that Gg « Gg =c fot BE 

e) Show that the sum of n independent identically distributed random variables 
(for example, n independent measurements of the same object), all distributed ac- 
cording to the normal law G,,, is distributed according to the law G, /;. From this it 
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follows in particular that the expected order of errors for the average of n such mea- 
surements when taken as the value of the measured quantity, equals 0 /,/n, where 
o is the probable error of an individual measurement. 


3. We recall that the function A(x) = ya a,x" is called the generating function 
of the sequence ao, d\,.... 

Suppose given two sequences {ax} and {bx}. If we assume that a, = by = 0 for 
k <0, then the convolution of the sequences {ax} and {b,x} can be naturally defined 
as the sequence {cy = ein Ambx—m}. Show that the generating function of the con- 
volution of two sequences equals the product of the generating functions of these 
sequences. 
4. a) Verify that if the convolution u * v is defined and one of the functions u and 
v is periodic with period T, then u * v is also a function of period T. 

b) Prove the Weierstrass theorem on approximation of a continuous periodic 
function by a trigonometric polynomial (see Remark 5). 

c) Prove the strengthened versions of the Weierstrass approximation theorem 
given in Example 4. 


5. a) Suppose the interior of the compact set K C R contains the closure E of the 


set E in Proposition 5. Show that in that case iy SOAR — y) dy = f(x) on E. 
b) From the expansion (1 — zvi=l+z2+22+4+.--- deduce that g(p,0) = 
1+pel@ 1 


Mio = 7+ pel’ + pel? +--- forO<p<l. 


c) Verify that if 0 < p < | and 


1 
P,(@) := Re g(p,9) = 5 + pcos@+ p* cos 20 fee, 
then the function P,(0) has the form 


1p? 
1 —2pcosé 4+ p2 


1 
P/O)= 5 


and is called the Poisson kernel for the disk. 

d) Show that the family of functions P, (6) depending on the parameter p has the 
following set of properties: P,(@) > 0, 4 >” Pp(@)d0 = 1, [2% ° P,(0) dd > 0 
aso—> 1-0. 

e) Prove that if f € C[0, 277], then the function 


1 20 
u(p,0) = -{ Pp(@ —t) f(t) dt 


is a harmonic function in the disk p < 1 and u(p, 0) = f(@) as p > 1 — 0. Thus, 
the Poisson kernel makes it possible to construct a function harmonic in the disk 
having prescribed values on the boundary circle. 

f) For locally integrable functions u and v that are periodic with the same pe- 
riod T, one can give an unambiguous definition of the convolution (convolution 
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over a period) as follows: 


a+T 
(u - v) (x):= / u(y)u(x — y)dy. 


The periodic functions on R can be interpreted as functions defined on the circle, 
so that this operation can naturally be regarded as the convolution of two functions 
defined on a circle. 

Show that if f(@) is a locally integrable 27 -periodic function on R (or, what is 
the same, f is a function on a circle), and the family P,(0) of functions depending 
on the parameter p has the properties of the Poisson kernel enumerated in d), then 
Ue P,)(0) > f(@) as p > 1 — Oat each point of continuity of f. 

JT 
6. a) Suppose g(x) := aexp(s4) for |x| < 1 and g(x) :=0 for |x| > 1. Let the 
constant a be chosen so that exes) dx = 1. Verify that the family of functions 
Qa(x) = +9(2) is an approximate identity as a — +0 consisting of functions in 
Co on R. 

b) For every interval J Cc R and every ¢ > 0 construct a function e(x) of class 
co such that 0 < e(x) < 1 on R, e(xv) = 1% € 7, and finally, suppe C Jp, 
where J, is the e-neighborhood (or the ¢-inflation) of the set J in R. (Verify that for 
a suitable value of a > 0 one can take e(x) to be x7 * @y.) 

c) Prove that for every ¢ > 0 there exists a countable set {ex} of functions ex, € 
Ee) (an €-partition of unity on R) that possesses the following properties: Vk € N, 
Vx € R (CO < eg (x) < 1); the diameter of the support supp ex of every function in the 
family is at most ¢ > 0; every point x € R belongs to only a finite number of the 
sets supp ex; >>, ex(x) = lonR. 

d) Show that for every open covering {U,, y € I”} of the open set G C R and 
every function gy € C‘)(G) there exists a sequence {y,; k € N} of functions gy € 
co that has the following properties: Vk ¢ Ndy € I” (supp gy C U,); every point 
x € G belongs to only a finite number of sets supp gx; >>, g(x) = G(x) on G. 

e) Prove that the set of functions oe interpreted as generalized functions is 
everywhere dense in the corresponding set C‘)(G) of regular generalized func- 
tions. 

f) Two generalized functions F; and F in D'(G) are regarded as equal on an 
open set U c Gif (Fi, g) = (2, ) for every function g € D(G) whose support is 
contained in U. Generalized functions F; and F> are regarded as locally equal at the 
point x € G if they are equal in some neighborhood U(x) Cc G of that point. Prove 
that (Fy) = Fo) & (F| = F» locally at each point x € G). 


zea for |x| < 1 and g(x) := 0 for |x| => 1. Show that 


Ie f ©) Gc (x) dx > 0 as e > +0 for every function f that is locally integrable on 
R, where g, (x) = g(). 

b) Taking account of the preceding result and the fact that (5, g) = p(0) 4 0, 
prove that the generalized function 6 is not regular. 


7. a) Let g(x) := exp( 
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c) Show that there exists a sequence of regular generalized functions (even cor- 
responding to functions of class Co) that converges in D’ to the generalized func- 
tion 6. (In fact every generalized function is the limit of regular generalized func- 
tions corresponding to functions in‘D = Cr In this sense the regular generalized 
functions form an everywhere dense set in D’, just as the rational numbers Q are 
everywhere dense in the real numbers R.) 


8. a) Compute the value (F, v) of the generalized function F € D’ on the function 
yg €Dif F =sinxé; F =2cosxd; F=(14+x7)6. 

b) Verify that the operation F > wF of multiplication by the function yw € 
C©) is a continuous operation in D’. 

c) Verify that linear operations on generalized functions are continuous in D’. 


9. a) Show that if F is the regular distribution generated by the function f(x) = 


{ 0 a *S0. then F’ = H, where H is the distribution corresponding to the Heaviside 
x for x>0, 


function. 


b) Compute the derivative of the distribution corresponding to the function |x|. 


10. a) Verify that the following limiting passages in D’ are correct: 


= 1x6; lim 


: a ‘ 
lim —+—; =75; lim 5 5 
a>+0a-+x a>+0 x 


a>+0 x2 + a? 


x 
Eee = In |x|. 
b) Show that if f = f(x) is a locally integrable function on R and f, = 
f(x +6), then f, > fin D’ ase 0. 
c) Prove that if {A,} is an approximate identity consisting of smooth functions 
as a > 0, then Fy = tee Aq(t) dt > H as a > 0, where Z is the generalized 
function corresponding to the Heaviside function. 


11. a) The symbol 5(x — a) usually denotes the 6-function shifted to the point a, 
that is, the generalized function acting on a function g € D according to the rule 
(d(x — a), p) = v(a). Show that the series }7,.7 6(x — k) converges in D’. 

b) Find the derivative of the function [x] (the integer part of x). 

c) A 27-periodic function on R is defined in the interval ]0, 277] by the formula 
Ff ho,27(x) = 5 — 3. Show that f’=—4 + Dyez 5(x — 2k). 

d) Verify that d(x — €) > d(x) ase 0. 

e) As before, denoting the 5-function shifted to the point ¢ by 6(x — €), show 
by direct computation that i(6 (x — €) — 8(x)) > —8'(x) = —8". 

f) Starting from the preceding limiting passage, interpret —d’ as the distribu- 
tion of charges corresponding to a dipole with electric moment +1 located at the 
point x = 0. Verify that (—6’, 1) = 0 (the total charge of a dipole is zero) and that 
(—6’, x) = 1 (its moment is indeed 1). 

g) An important property of the 6-function is its homogeneity: d6(Ax) = 
4.7!8(x). Prove this equality. 
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12. a) For the generalized function F defined as (F, y) = i ./xo(x) dx, verify 
the following equalities: 


1 +00 
(F’, j= ae OO) a 
2 Jo JX 
" 1 (** g(x) — (0) 
(F".o\=-7 f ——ap os 
+00 = = , 
(ee, \= 3 g(x) — g(0) — xg’(0) tes 
8 0 x9/2 
—1)""! Qn — 3)! 
(Fo) =! ) _ 3) " 
n—2 
+00 v(x) — y(0) — xg'(0) —--- a9") 0) 
: if 2n+1 dx. 
as x2 


b) Show that ifn — 1 < p <n and the generalized function a is defined by 
the relation 


xn-2 


py.gh= fe Se ome” PO) 
0 


xX. 


xP 


Then its derivative is the function — px,” +!) defined by the relation 


n—-1 
= +00 v(x) — p(0) — xg'(0) —--- — 2 gD) 
me, rf (n—1)! as 


(—p y)= a xPtl 


13. The generalized function defined by the equality 


+00 ap 400 
(Fee) =Pv | 2 ax(s= lim ( fo+f 2 ts) 
—oo x é>+0\ Jo : x 


is denoted Pt. Show that 


a) (P4, 9) = f° Se ax. 
b) (in|x)/ =P. 
c) (PL), x) = for? Pte 4O ay, 
d) sho = limys+40 pty = — i778 + PE. 
14. Some difficulties may arise with the definition of the multiplication of gener- 


alized functions: for example, the function |x|~7/? is absolutely (improperly) inte- 
grable on R; it generates a corresponding generalized function ae |x|~?3. p(x) dx, 
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but its square |x|~4/? is no longer an integrable function, even in the improper sense. 
The answers to the following questions show that it is theoretically impossible to 
define a natural associative and commutative operation of multiplication for any 
generalized functions. 


a) Show that f(x)é = f(0)6 for every function f ¢ C™. 

b) Verify that xP 4 =1 in D’. 

c) If the operation of multiplication were extended to all pairs of generalized 
functions, it would at least not be associative and commutative. Otherwise, 


1 1 1 1 
0=0P— = (x8(x))P— = (8(x)x)P— = 8(x) | xP- | =8(x)1 = 18%) = 8. 
x x x x 
15. a) Show that a fundamental solution E for the linear operator A : D’ > D’ is 
in general ambiguously defined, up to any solution of the homogeneous equation 
Af =0. 
b) Consider the differential operator 


7 dx” dx"-1 


d d” qr-l 
P(x.) + ay (x) —— +---+an(x). 


Show that if wp = ug(x) is a solution of the equation P(x, yuo = 0 that sat- 
isfies the initial conditions u(0) = --- =u"? (0) = 0 and u("~ (0) = 1, then the 
function E(x) = H(x)uo(x) (where H(X) is the Heaviside function) is a funda- 
mental solution for the operator P(x, 4). 

c) Use this method to find the fundamental solutions for the following opera- 


tors: 
d de 5 d™ d m 
at ’ 7? = d ay? re oJ € N. 
(= +0) (= ae ) dx” (= +a) “ 


d) Using these results and the convolution, find solutions of the equations 
au — f, (4 4a)" = f, where f €C(R,R). 


17.5 Multiple Integrals Depending on a Parameter 


In the first two subsections of the present section we shall exhibit properties of 
proper and improper multiple integrals depending on a parameter. The total re- 
sult of these subsections is that the basic properties of multiple integrals depending 
on a parameter do not differ essentially from the corresponding properties of one- 
dimensional integrals depending on a parameter studied above. In the third subsec- 
tion we shall study the case of an improper integral whose singularity itself depends 
on a parameter, which is important in applications. Finally, in the fourth subsection 
we shall study the convolution of functions of several variables and some specifi- 
cally multi-dimensional questions on generalized functions closely connected with 
integrals depending on a parameter and the classical integral formulas of analysis. 
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17.5.1 Proper Multiple Integrals Depending on a Parameter 


Let X be a measurable subset of R”, for example, a bounded domain with smooth 
or piecewise-smooth boundary, and let Y be a subset of R”. 
Consider the following integral depending on a parameter: 


Fo)= fo. yar. (17.72) 


where the function f is assumed to be defined on the set X x Y and integrable on 
X for each fixed value of y € Y. 
The following propositions hold. 


Proposition 1 Jf X x Y is a compact subset of R"t™ and f € C(X x Y), then 
FecC(Y). 


Proposition 2 [f Y isadomaininR”, f € C(X x Y), and ot € C(X x Y), then the 


function F is differentiable with respect to y' in Y, where y= Ce re 
and 
OF of 
sa) = | za, y)dex. (17.73) 
dy’ x dy! 


Proposition 3 If X and Y are measurable compact subsets of R" and R” respec- 
tively, while f € C(X x Y), then FE C(Y) C R(X), and 


[Fore = ay [ fee. ydx= f ax fro. »yay. (17.74) 
Y Y X Xx Y 


We note that the values of the function f here may lie in any normed vector 
space Z. The most important special cases occur when Z is R, C, R”, or C”. In 
these cases the verification of Propositions 1-3 obviously reduce to the case of their 
proof for Z = R. But for Z = R the proofs of Propositions | and 2 are verbatim 
repetitions of the proof of the corresponding propositions for a one-dimensional 
integral (see Sect. 17.1), and Proposition 3 is a simple corollary of Proposition 1 
and Fubini’s theorem (Sect. 11.4). 


17.5.2. Improper Multiple Integrals Depending on a Parameter 


If the set X C R” or the function f(x, y) in the integral (17.72) is unbounded, it 
is understood as the limit of improper integrals over sets of a suitable exhaustion 
of X. In studying multiple improper integrals depending on a parameter, as a rule, 
one is interested in particular exhaustions like those that we studied in the one- 
dimensional case. In complete accord with the one-dimensional case, we remove 


17.5 Multiple Integrals Depending on a Parameter 473 


the e-neighborhood of the singularities,® find the integrals over the remaining parts 
X, of X and then find the limit of the values of the integrals over X, as € > +0. 

If this limiting passage is uniform with respect to the parameter y € Y, we say 
that the improper integral (17.72) converges uniformly on Y. 


Example I The integral 


F(a)= /[ en POP+Y) dy dy 
R2 


results from the limiting passage 


Di Sod 2; 2 
// e OF) de dy := lim // eR F+Y) dx dy 
R2 e>+0 x24+y2<1/e2 


and, as one can easily verify using polar coordinates, it converges for A > 0. Fur- 
thermore, it converges uniformly on the set Ey, = {A € R| A > Ao > O}, since for 
rE Exo, 


2 2 vid 2 
0< // e AO dx dy < // e 0 +Y dx dy, 
x?-+y?> 1/6? x24y2>1/e2 


and this last integral tends to 0 as ¢ — 0 (the original integral F(A) converges at 
A =Ao > 0). 


Example 2 Suppose, as always, that B(a,r) = {x € R” | |x —a| <r} is the ball of 
radius r with center at a € R”, and let y € R”. Consider the integral 


_ |x — y| a |x — y| 
F(X) = de = ti dy 
Bo,1) (i — |x)” e>+0JB0,1-2) (1 — |x|)” 


Passing to polar coordinates in R”, we verify that this integral converges only for 
a < 1. If the value a < | is fixed, the integral converges uniformly with respect to 
the parameter y on every compact set Y C R”, since |x — y| < M(Y) € R in that 
case. 


We note that in these examples the set of singularities of the integral was inde- 
pendent of the parameter. Thus, if we adopt the concept given above of uniform 
convergence of an improper integral with a fixed set of singularities, it is clear that 
all the basic properties of such improper multiple integrals depending on a parameter 
can be obtained from the corresponding properties of proper multiple integrals and 
theorems on passage to the limit for families of functions depending on a parameter. 

We shall not take the time to explain these facts again, which are theoretically 
already familiar to us, preferring instead to use the machinery we have developed 


8That is, the points in every neighborhood of which the function f is unbounded. If the set X is 
also unbounded, we remove a neighborhood of infinity from it. 
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to study the following very important and frequently encountered situation in which 
the singularity of an improper integral (one-dimensional or multi-dimensional) itself 
depends on a parameter. 


17.5.3 Improper Integrals with a Variable Singularity 


Example 3 As is known, the potential of a unit charge located at the point x € R? 
is expressed by the formula U(x, y) = =p where y is a variable point of R?. If 
the charge is now distributed in a bounded region X C R? with a bounded density 
[4(x) (equal to zero outside X/), the potential of a charge distributed in this way can 


be written (by virtue of the additivity of potential) as 


p(x) dx 


(17.75) 
x |x—y| 


Uo)= [UG yn) ar = 
The role of the parameter in this last integral is played by the variable point 
y € R’. If the point y lies in the exterior of the set X, the integral (17.75) is a proper 
integral; but if y € X, then |x — y| > 0 as X 5 x > y, and y becomes a singularity 
of the integral. As y varies, this singularity thus moves. 
Since U(y) = lime_, +40 Ue(y), where 


M(x) 
U,(y) =i dx, 
X\B(y,e) 1X — YI 


it is natural to consider, as before, that the integral (17.75) with a variable singularity 
converges uniformly on the set Y if Us(y) = U(y) on Y as ¢ > +0. 
We have assumed that |(x)| < M € R on X, and therefore 


d d 
/ p(x) dx <u | ey 
XNB(y,e) IX — YI B 


(y,€) |x — y| 

This estimate shows that |U(y) — Uz(y)| < 2 Me? for every ye R?, that is, the 
integral (17.75) converges uniformly on the set Y = R?. 

In particular, if we verify that the function U;(y) is continuous with respect to y, 
we will then be able to deduce from general considerations that the potential U(y) is 
continuous. But the continuity of U;(y) does not follow formally from Proposition 1 
on the continuity of an improper integral depending on a parameter, since in the 
present case the domain of integration X\B(y, ¢) changes when y changes. For that 
reason, we need to examine the question of the continuity of U;(y) more closely. 

We remark that for |y — yo| <¢, 


uy = | mo + f L(x) dx 
xX ( 


\B(y0.2e) le — yI X\B(y,2))NB(0.2e) |X — Yl 
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The first of these two integrals is continuous with respect to y assuming |y — 
yo| < €, being a proper integral with a fixed domain of integration. The absolute 
value of the second does not exceed 


Mdx 2 
=87Mse-. 
B(yo.2e) 1% — YI 


Hence the inequality |U;(y) — Ue(yo)| < ¢ + 162 Me? holds for all values of y suf- 
ficiently close to yo, which establishes that U.(y) is continuous at the point yo € R°. 

Thus we have shown that the potential U (y) is a continuous function in the whole 
space R?. 


These examples provide the basis for adopting the following definition. 


Definition 1 Suppose the integral (17.72) is an improper integral that converges 
for each y € Y. Let X, be the portion of the set X obtained by removing from 
X the ¢-neighborhood of the set of singularities of the integral,’ and let F;(y) = 

£ X, FS (x, y) dx. We shall say that the integral (17.72) converges uniformly on the set 
Y if Fe(y) = F(y) on Y as e > +0. 


The following useful proposition is an immediate consequence of this definition 
and considerations similar to those illustrated in Example 3. 


Proposition 4 [f the function f in the integral (17.72) admits the estimate 
|f(x, y)| < ree where M ER, x € X CR", ye Y CR", anda <n, then the 
integral converges uniformly on Y. 


Example 4 In particular, we conclude on the basis of Proposition 4 that the integral 


von= | Gal 2 
x 


|x — y/3 


obtained by formal differentiation of the potential (17.75) with a rade to the vari- 
x'—y 
yh 
As in Example 3, it follows from this that the function V;(y) is continuous on R?. 
Let us now verify mae the ee U(y) — the potential (17.75) — really does 
have a partial derivative 2 U and that $% ar y)=Vi0). 


Ji< 


able y! (i = 1, 2,3) converges uniformly on Y = R?, since Oe RE" 


To do this it sbeinualy suffices to vents that 


b * 
[vio 2)e!=004 YP Pi 
a 


° See the footnote on p. 473. 
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But in fact, 


w(x)! — y') 
[ Vi(y) dy! = ix yf dr = 
a |x = | 
Ln gl ; 
= wonae f Me hay = 
x a |x = | 
b 
0 1 . 
x a Jy! \|x— yl 
7 ( | w(x) *)/ 
x Ix—yl 
The only nontrivial point in this computation is the reversal of the order of inte- 
gration. In general, in order to reverse the order of improper integrals, it suffices to 
have a multiple integral that converges absolutely with respect to the whole set of 
variables. This condition holds in the present case, so that the interchange is justi- 


fied. Of course, it could also be justified directly due to the simplicity of the function 
involved. 


=U) ying 


i=a 


Thus, we have shown that the potential U(y) generated by a charge distributed 
in R? with a bounded density is continuously differentiable in the entire space. 

The techniques and reasoning used in Examples 3 and 4 enable us to study the 
following more general situation in a very similar way. 

Let 


Fo)= | Kye) Wes, ya, (17.76) 


where X is a bounded measurable domain in R”, the parameter y ranges over 
the domain Y Cc R”, with n < m, g : X — R” is a smooth mapping satisfy- 
ing rankg’(x) =n, and ||g’(x)|| > c > 0, that is, g defines an n-dimensional 
parametrized surface, or, more precisely, an n-path in R”. Here K € C(R”\0, R), 
that is, the function K(z) is continuous everywhere in R” except at z = 0, near 
which it may be unbounded; and w : X x Y > R is a bounded continuous function. 
We shall assume that for each y € Y the integral (17.76) (which in general is an 
improper integral) exists. 
In the integral (17.75) that we considered above, in particular, we had 


n=m, gx)=x, Vv@.y=n@), K@=lz\ 7 


It is not difficult to verify that under these restrictions on the function g, Defi- 
nition | of uniform convergence of the integral (17.76) means that for every a > 0 
one can choose ¢ > 0 such that 


if 1 K(y— 9(x)) w(x, y) dx <a, (17.77) 
y—(x)|<e 
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where the integral is taken over the set!° {x € X | |y — g(x)| < }. 
The following propositions hold for the integral (17.76). 


Proposition 5 [f the integral (17.76) converges uniformly on Y under the hypothe- 
ses described above on the functions y, W, and K, then F € C(Y,R). 


Proposition 6 [fit is known in addition that the function w in the integral (17.76) is 
independent of the parameter y (that is, w(x, y) = W(x)) and K € COR" \0, R), 
then if the integral 


[ 0 — o(x)) w(x) dx 


converges uniformly on the set y € Y, one can say that the function F has a contin- 
uous partial derivative oF jand 


ay!’ 
OF OK 
ay 0 = | S50 900) wood. (17.78) 


The proofs of these propositions, as stated, are completely analogous to those in 
Examples 3 and 4, and so we shall not take the time to give them. 

We note only that the convergence of an improper integral (under an arbitrary 
exhaustion) implies its absolute convergence. In Examples 3 and 4 the hypothesis 
of absolute convergence was used in the estimates and in reversing the order of 
integration. As an illustration of the possible uses of Propositions 5 and 6, let us 
consider another example from potential theory. 


Example 5 Suppose a charge is distributed on a smooth compact surface § C R? 
with surface density v(x). The potential of such a charge distribution is called a 
single-layer potential and is obviously represented by the surface integral 


uo= | Vee (17.79) 
s |x-y| 


Suppose v is a bounded function. Then for y ¢ S this integral is proper, and the 
function U(y) is infinitely differentiable outside S. 

But if y € S, the integral has an integrable singularity at the point y. The singu- 
larity is integrable because the surface S is smooth and differs by little from a piece 
of the plane R? near the point y € S; and we know that a singularity of type 1/r® 
is integrable in the plane if a < 2. Using Proposition 5, we can turn this general 
consideration into a formal proof. If we represent S locally in a neighborhood V, of 


'OHere we are assuming that the set X itself is bounded in R”. Otherwise one must supplement 
inequality (17.77) with the analogous inequality in which the integral is taken over the set {x € X | 
|x| > 1/e}. 
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the point y € S in the form x = g(t), where t € V; C IR? and rank gy’ = 2, then 


/ v(x) do (x) / ve) |g ( dp dy 
= et( —, —— )dt, 

vy |x—yl v, ly — g(t)! dt’ at! 
and, applying Proposition 2, we also verify that the integral (17.79) represents a 
function U(y) that is continuous on the entire space R?. 

Outside the support of the charge, as already noted, the three-dimensional poten- 
tial (17.75) and the single-layer potential (17.79) are infinitely differentiable. Carry- 
ing out this differentiation under the integral sign, we verify in a unified manner that 


outside the support of the charge the potential, like the function 1/|x — y|, satisfies 
Laplace’s equation AU = 0 in R?, that is, it is a harmonic function in this domain. 


17.5.4 *Convolution, the Fundamental Solution, and Generalized 
Functions in the Multidimensional Case 


a. Convolution in R” 


Definition 2 The convolution u * v of real- or complex-valued functions u and v 
defined in R” is defined by the relation 


(u * v)(x) =f u(y)u(x — y)dy. (17.80) 


Example 6 Comparing formulas (17.75) and (17.80), we can conclude, for example, 
that the potential U of a charge distributed in R? with density s(x) is the convo- 
lution (u * E) of the function jz and the potential EF of a unit charge located at the 
origin of R>. 

Relation (17.80) is a direct generalization of the definition of convolution given 
in Sect. 17.4. For that reason, all the properties of the convolution considered in 
Sect. 17.4 for the case n = | and their proofs remain valid if R is replaced by R”. 

An approximate identity in R” is defined just as in R with R replaced by R” and 
U (0) understood to be a neighborhood of the point 0 € R” in R”. 

The concept of uniform continuity of a function f:G— C ona set ECG, 
and with it the basic Proposition 5 of Sect. 17.4 on convergence of the convolution 
f * Aq to f, also carry over in all its details to the multi-dimensional case. 

We note only that in Example 3 and in the proof of Corollary | of Sect. 17.4 
x must be replaced by |x| in the definition of the functions A, (x) and g(x). Only mi- 
nor changes are needed in the approximate identity given in Example 4 of Sect. 17.4 
for the proof of the Weierstrass theorem on approximation of periodic functions by 
trigonometric polynomials. In this case it is a question of approximating a function 
f (x!, ..., x") that is continuous and periodic with periods T, T2,..., T, respec- 


tively in the variables x xe x, 
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The assertion amounts to the statement that for every ¢ > 0 one can exhibit a 
trigonometric polynomial in 1 variables with the respective periods T;, 72,..., Tn 
that approximates f on R” within e. 

We confine ourselves to these remarks. An independent verification of the prop- 
erties of the convolution (17.80) for n € N, which were proved for the case n = 1 in 
Sect. 17.4, will be an easy but useful exercise for the reader, helping to promote an 
adequate understanding of what was said in Sect. 17.4. 


b. Generalized Functions of Several Variables 


We now take up certain multi-dimensional aspects of the concepts connected with 
generalized functions, which were introduced in Sect. 17.4. 

As before, let C°)(G) and C&G) denote respectively the sets of infinitely 
differentiable functions in the domain G C R” and the set of infinitely differen- 
tiable functions of compact support in G. If G = R”, we shall use the respective 
abbreviations C‘°) and ae Let m := (mj,...,™m,) be a multi-index and 


g™ — <a 7 - : a a 
H axl eats ax” ‘i 


In CAG we introduce convergence of functions. As in Definition 7 of 


Sect. 17.4, we consider that gj — g in EG) as k — oo if the supports of all 
the functions of the sequence {g;} are contained in one compact subset of G and 
on” = y on G for every multi-index m as k — oo, that is, the functions con- 
verge uniformly, and so do all of their partial derivatives. 

Given this, we adopt the following definition. 


Definition 3 The vector space CG) with this convergence is denoted D(G) 
(and simply D if G = R”) and is called the space of fundamental or test functions. 

Continuous linear functionals on D(G) are called generalized functions or dis- 
tributions. They form the vector space of generalized functions, denoted D'(G) (or 
D’ when G = R”"). 


Convergence in D’(G), as in the one-dimensional case, is defined as weak (point- 
wise) convergence of functionals (see Definition 6 of Sect. 17.4). 

The definition of a regular generalized function carries over verbatim to the 
multi-dimensional case. 

The definition of the 6-function and the 45-function shifted to the point x9 € G 
(denoted 5(x9), or more often, but not always happily, 6(x — xo)) also remain the 
same. 

Now let us consider some examples. 


480 17 Integrals Depending on a Parameter 


Example 7 Set 
1 _ lz? 

——_—e  4a21 
(2a/xt)" 
where a > 0, t > 0, x € R”. We shall show that these functions, regarded as regular 
distributions in R”, converge to the 5-function on R” as t > +0. 

For the proof it suffices to verify that the family of functions A; is an approximate 
identity in R” as t > +0. 

Using a change of variable, reduction of the multiple integral to an iterated inte- 
gral, and the value of the Euler—Poisson integral, we find 


[ amu=— | etme )- (few aw) =I 
RW)" Ir, 2avt)— Wm" Joo = 


Next, for any fixed value of r > 0 we have 


1 2 
Aj (x) dx = a= el" dé > 1, 
hee J)" JB0, 547) 


A, (x) := 


’ 


as t > +0. 
Finally, taking account of the fact that A;(x) is nonnegative, we conclude that 
these functions indeed constitute an approximate identity in R”. 


Example § A generalization of the 6-function (corresponding, for example, to a unit 
charge located at the origin in R”) is the following generalized function 65 (corre- 
sponding to a distribution of charge over a piecewise-smooth surface S with a dis- 
tribution of unit surface density). The effect of 6s on the function g € D is defined 
by the relation 


Cee / abide: 
S 


Like the distribution 6, the distribution 55 is not a regular generalized function. 
Multiplication of a distribution by a function in D is defined in R” just as in the 
one-dimensional case. 


Example 9 If  € D, then j1d5 is a generalized function acting according to the rule 


(u5s,9) = [econesrae. (17.81) 


If the function (x) were defined only on the surface S, Eq. (17.81) could be 
regarded as the definition of the generalized function ds. By natural analogy, the 
generalized function introduced in this way is called a single layer on the surface S 
with density A. 


Differentiation of generalized functions in the multi-dimensional case is defined 
by the same principle as in the one-dimensional case, but has a few peculiarities. 
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If F € D’(G) and G CR", the generalized function ar is defined by the relation 
OF ) 
-,Q9):= F, ? i 
ox! ox! 


(F™, g)= (-1)'""(F, p™), (17.82) 


It follows that 


where m = (my, ..., mx) is a multi-index and |m| = )~"_, mj. 


: 2 . 2 2 
It is natural to verify the relation a = a? —. But that follows from the 
xox dxJ ax! 


equality of the right-hand sides in the relations 


a°F ale ap 
axtaxt NV? axdaxt f’ 


a°F ole ap 
satan NV? axtaxd f 


which follows from the classical equality 209 = 20 which holds for every 


: ax! daxJ axJax!? 
function g € D. 


Example 10 Now consider an operator D = )*,,, dm D™, where m = (m,..., Mn) 

is a multi-index, D” = (ym tee (son yi", Gm are numerical coefficients, and 

the sum extends over a finite set of multi-indices. This is a differential operator. 
The transpose or adjoint of D is the operator usually denoted 'D or D* and 


defined by the relation 


(DF, 9) =:(F,'D@), 


which must hold for all g € D and F € D’. Starting from Eq. (17.82), we can now 
write the explicit formula 


‘p= Yi-1)!"am D™ 


m 


for the adjoint of the differential operator D. 

In particular, if all the values of |m| are even, the operator D is self-adjoint, that 
is, ’D=D. 

It is clear that the operation of differentiation in D’(IR”) preserves all the prop- 
erties of differentiation in D’ (IR). However, let us consider the following important 
example, which is specific to the multi-dimensional case. 


Example 11 Let S be a smooth (n — 1)-dimensional submanifold of R”, that is, S 
is a smooth hypersurface. Assume that the function f defined on R”\S is infinitely 
differentiable and that all its partial derivatives have a limit at every point x € S$ 
under one-sided approach to x from either (local) side of the surface S. 


482 17 Integrals Depending on a Parameter 


The difference between these two limits will be the jump / at of the partial 
derivative under consideration at the point x corresponding to a particular direction 
of passage across the surface S at x. The sign of the jump changes if that direction is 
reversed. The jump can thus be regarded as a function defined on an oriented surface 
if, for example, we make the convention that the direction of passage is given by an 
orienting normal to the surface. 

The function ae is defined, continuous, and locally bounded outside S, and by 
the assumptions just made f is locally ultimately bounded upon approach to the 
surface S itself. Since S is a submanifold of R”, no matter how we complete the 
definition of aa on S, we obtain a function with possible discontinuities on only S, 
and hence locally integrable in R”. But integrable functions that differ on a set of 
measure zero have equal integrals, and therefore, without worrying about the values 
on S, we may assume that at generates some regular generalized function {25} 
according to the rule 


(sof e)= JL, (ga -e) er. 


We shall now show that if f is regarded as a generalized function, then the fol- 
lowing important formula holds in the sense of differentiation of generalized func- 
tions: 

0 0 
ie a. + UI f)scosajds, (17.83) 
ox! ox! 
where the last term is understood in the sense of Eq. (17.81), (fs is the jump of 
the function f at x € S corresponding to either of the two possible directions of the 
unit normal n to S at x, and cosq; is the projection of n onto the x'-axis (that is, 
n= (cOSQ],...,COSQ,)). 


Proof Formula (17.83) generalizes Eq. (17.64), which we use to derive it. 
For definiteness we consider the case i = 1. Then 


of dp dy 
(are) = (fger)= Ly gee= 
+00 


2h 
+00 9 
= J. | dx?---dx"| (Pot OF pag = 
6 (Ox! 
x2. 
0 
=i. oar t f fned?.--a" 
R, 0x 
XEN 
Here the jump [ f of f is taken at the point x = (x!,x?,...,x”) € S as one 


passes through the surface at that point in the direction of the positive x;-axis. The 
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value of the function g in computing the product (| f)@ is taken at the same point. 
Hence, this last integral can be written as a surface integral of first kind 


i (I f)pcosay do, 
S 


where c is the angle between the direction of the positive x;-axis and the normal to 
S at x, direct so that in passing through x in the direction of that normal the function 
f has precisely the jump | f. This means only that cosa; > 0. It remains only to 
remark that if we choose the other direction for the normal, the sign of the jump 
and the sign of the cosine would both reverse simultaneously; hence the product 
(J f) cosa, does not change. 


Remark 1 As can be seen from this proof, formula (17.83) holds once the jump 
(J f)s of f is defined at each point x € S, and a locally integrable partial derivative 


“F exists outside of S in IR”, perhaps as an improper integral generating a regular 


axJ 
: 5 af 
generalized function { Saal fe 


Remark 2 At points x € S at which the direction of the x!-axis is not transversal 
to S, that is, it is tangent to S, difficulties may arise in the definition of the jump | f 
in the given direction. But it can be seen from (17.83) that its last term is obtained 


from the integral 
[- fcneae a 


XX 


The projections of the set E on x*,...,x”-hyperplane has (n — 1)-dimensional 


measure zero and therefore has no effect on the value of the integral. Hence we can 
regard the form (17.83) as having meaning and being valid always if (J f)s cosa; is 
given the value 0 when cosa; = 0. 


Remark 3 Similar considerations make it possible to neglect sets of area zero; there- 
fore one can regard formula (17.83) as proved for piecewise-smooth surfaces. 

As our next example we shall show how the classical Gauss—Ostrogradskii for- 
mula can be obtained directly from the differential relation (17.83), and in a form 
that is maximally free of the extra analytic requirements that we informed the reader 
of previously. 


Example 12 Let G be a finite domain in IR” bounded by a piecewise-smooth sur- 
face S. Let A=(A!,..., A”) be a vector field that is continuous in G and such that 
the function divA = )77_, oA is defined in G and integrable on G, possibly in the 
improper sense. 

If we regard the field A as zero outside G, then the jump of this field at each point 
x of the boundary S of the domain G when leaving G is —A(x). Assuming that n is 
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a unit outward normal vector to S, applying formula (17.83) to each component A! 
of the field A and summing these equalities, we arrive at the relation 


div A = {div A} — (A-n)és, (17.84) 


in which A - n is the inner product of the vectors A and n at the corresponding point 
xeS. 

Relation (17.84) is equality of generalized functions. Let us apply it to the func- 
tion y € co equal to | on G (the existence and construction of such a function 
has been discussed more than once previously). Since for every function g € D 


(div A, 9) =-| (A - Vg) dx (17.85) 
RR” 


(which follows immediately from the definition of the derivative of a generalized 
function), for the field A and the function y we obviously have (div A, wv) = 0. But, 
when we take account of Eq. (17.84) this gives the relation 


O= ({div A}, Vv) — (A -n)ds, Vv), 


which in classical notation 
o= | div A dx - fam do (17.86) 
G S 
is the same as the Gauss—Ostrogradskii formula. 


Let us now consider several important examples connected with differentiation 
of generalized functions. 


Example 13 We consider the vector field A = ae defined in R>\0 and show that in 


the space D’ (IR?) of generalized functions we have the equality 


div — Ans. (17.87) 


We remark first that for x 4 0 we have div LP = 0 in the classical sense. 


Now, using successively the definition of div A in the form (17.85), the definition 
x 


of an improper integral, the equality div a= 0 for x ¢ 0, the Gauss—Ostrogradskii 


formula (17.86), and the fact that ¢ has compact support, we obtain 


: Xx x 
(av xP o) ~ 2 ( xP vo«s)) 


lim -| (Zs: ve) d= 
e>+0 é<|x|<l/e |x| 
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lim -{ aiv( 2") dx = 
e>+0 é<|x|<I/e |x| 


(x +n) 
= lim -| g(x) 5 do = 47 g(0) = (46, ¢). 
|x|=e 


é>+0 |x| 


For the operator A : D'(G) — D’(g), as before, we define a fundamental solution 
to be a generalized function E C D’(G) for which A(E) =6. 
Example 14 We verify that the regular generalized function E(x) = -—aE in 
D’ (IR?) is a fundamental solution of the ee A= (4 + ( ss yr +( 5 2, 

Indeed, A = div grad, and grad E(x) = Ge ine for x #0, and therefore ihe equal- 
ity div grad EF = 6 follows from relation (17.87). 

As in Example 13, one can verify that for any n € N, n > 2, we have the following 
relation in R”: 


=o,6, (17.87’) 


vy — 
|x|” 


where on = F AS is the area of the unit sphere in R”. 


Hence we can conclude upon taking account of the relation A = div grad that 
Aln|X|=278 in R? 


and 
1 


|x|"-2 = 


—(n—2)o,5 inR",n>2 


Example 15 Let us verify that the function 


H(t _ ke? 
Pepa 


(2a/xt)" 


where x € R”, t € R, and H is the Heaviside function (that is, we set E(x, t) =0 
when ¢ < 0) satisfies the equation 


(> = aye = 8. 
ot 


Here A is the Laplacian with respect to x in R”, and 6 = 6(x, f) is the 6-function 
inR? xR, =R"*!. 

When t > 0, we have E € C)(R"*!) and by direct differentiation we verify 
that 


(> -«a)E=0 when t > 0. 
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Taking this fact into account along with the result of Example 7, we obtain for 
any function g € D(R"*!) 


a 
((a-24)ee)= 
__tr {2 *a) - 
(Gres) 
+00 
--| arf Bt.( 3 +02) dx 
0 n ot 


; +00 dp 5 
=— lim dt E(x,t) are Ag |) dx = 


e>+0 


+00 
= ie E(x, €)g(x, oar f ar [ (F-2ae) oar] = 


= lim if. E(x, €)g(x, oar [ B(x, )(9C4, 8) ~ 0(8,0)) as = 


= lim Ete E)p(x, 0) dx = (0, 0) = (4, @). 
e>+0 


Example 16 Let us show that the function 
E(x,t) : H (at — |x|) 
x,t) = —H (at — |x]), 

2a 


where a > 0,x € R}, te R} , and #/ is the Heaviside function, satisfies the equation 


ge 
(= aa )E=8 


in which 5 = 5(x, f) is the 5-function in the space D’(R! x R;) = = D’'(R?). 
a 2 


Letge D(R?). Using the abbreviation UO, := at 4 5d? 


we find 


( aE, 9) =(E, nor ax | E(s,t) ag(x,t)dt= 
a +00 ao +00 Q 
> arf, ar a5 ff u [ee : 
1 +00 +00 
= ay a ee al eh Cen aes 
2a J_oo Ot a 2 Jo ox ox 


1 rt3 dy 1 to do 
==, — (at, t)dt — = —(—-at,t)dt = 
2Jo dt 2Jo dt 


17.5 Multiple Integrals Depending on a Parameter 487 


1 1 
= 5 P00) 5 O00) 910, 0) = (8, 


In Sect. 17.4 we have discussed in detail the role of the system function of the 
operator and the role of the convolution in the problem of determining the input u 
from the output w of a translation-invariant linear operator Au = w. Everything that 
has been discussed on that score carries over to the multi-dimensional case without 
any changes. Hence, if we know the fundamental solution E of the operator A, that 
is, if AE = 4, then one can present the solution u of the equation Au = f as the 
convolution u = f * E. 


Example 17 Using the function E(x, t) of Example 16, one can thus present the 


solution 
1 t x+a(t—T) 
uet=5- [ar f P(E, 1) dé 
2a 0 x 


—a(t—T) 


of the equation 


’ 


which is the convolution f * E of the functions f and E and necessarily exists 
under the assumption, for example, that the function f is continuous. By direct 
differentiation of the resulting integral with respect to the parameters, one can easily 
verify that u(x, f) is indeed a solution of the equation Lau = f. 


Example 18 Similarly, on the basis of the result of Example 15 we find the solution 


ft) - it 
u(x, n= [is fh ata) naar ) dé 


of the equation 5- ou — Au = f, for example, under the assumption that the function 


f is continuous “atid bounded, which guarantees the existence of the convolution 
f * E. We note that these assumptions are made only for example, and are far from 
obligatory. Thus, from the point of view of generalized functions one could pose 
the question of the solution of the equation ou — Au = f taking as f(x,f) the 
generalized function g(x) - 6(t), where g € D(R”) and 6 € D’(R). 


The formal substitution of such a function f under the integral sign leads to the 


relation 
gE) _— bs? 

u(x,t) = ——+—e 4 dé, 

— [. [2a/nt]”" 5 
Applying the rule for differentiating an integral depending on a parameter one 
can verify that this function is a solution of the equation ou aAu = 0 for t > 0. 
We note that u(x,t) > g(x) as t ~ +0. This follows from the result of Exam- 
ple 7, where it was established that the family of functions encountered here is an 


approximate identity. 
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Example 19 Finally, recalling the fundamental solution of the Laplace operator ob- 
tained in Example 14, we find the solution 


f(E) dé 
u(x) = 
Rn [x —6| 
of the Poisson equation Au = —4zf, which up to notation and relabeling is the 


same as the potential (17.75) for a charge distributed with density f, which we 
considered earlier. 

If the function f is taken as v(x)ds, where S is a piecewise smooth surface in 
R:, formal substitution into the integral leads to the function 


a, ee 
u(x) = | 
s le-él 


which, as we know, is a single-layer potential; more precisely, the potential of a 
charge distributed over the surface S C R? with surface density v(x). 


17.5.5 Problems and Exercises 


1. a) Reasoning as in Example 3, where the continuity of the three-dimensional 
potential (17.75) was established, show that the single-layer potential (17.79) is 
continuous. 

b) Verify the full proof of Propositions 4 and 5. 


2. a) Show that for every set M C R” and every ¢ > 0 one can construct a function 
f of class C‘)(R”, R) satisfying the following three conditions simultaneously: 
Vx €R” O< f(x) < 1); Vx E M (f(x) = 1); supp f C Mz, where M, is the e- 
blowup (that is, the e-neighborhood) of the set M. 

b) Prove that for every closed set M in R” there exists a nonnegative function 
f €C©)(R", R) such that (f (x) =0) & (x € M). 


3. a) Solve Problems 6 and 7 of Sect. 17.4 in the context of a space R” of arbitrary 
dimension. 
b) Show that the generalized function 55 (single layer) is not regular. 


4. Using convolution, prove the following versions of the Weierstrass approxima- 
tion theorem. 


a) Any continuous function f : 7 — R on a compact n-dimensional interval 
I CR" can be uniformly approximated by an algebraic polynomial in n variables. 

b) The preceding assertion remains valid even if J is replaced by an arbitrary 
compact set K C R and we assume that f €¢ C(K,C). 

c) For every open set G C R” and every function f ¢ C”)(G, R) there exists 
a sequence { P;} of algebraic polynomials in n variables such that pe = f™ on 
each compact set K C G as k > o for every multi-index a = (q1,...,a@,) such 
that |a| <m. 
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d) If G is a bounded open subset of R” and f € C‘)(G,R), there exists a 
sequence {h} of algebraic polynomials in n variables such that pe > f™ for 
every @ = (Q,...,Q@n) ak—> Ow. 

e) Every periodic function f € C(R”, R) with periods T,, Ty, ..., T,, in the vari- 


ables x!,...,x”, can be uniformly approximated in R” by trigonometric polyno- 
mials in n variables having the same periods 7), 72,..., 7, in the corresponding 
variables. 


5. This problem contains further information on the averaging action of convolu- 
tion. 


a) Previously we obtained the integral Minkowski inequality 


I/p I/p I/p 
(/ Jats) +000)" ax) <([ jal?) ax) +(f 1" x) ax) 
xX xX x 


for p > 1 on the basis of this numerical Minkowski inequality. 
The integral inequality in turn enables us to predict the following generalized 


integral Minkowski inequality: 
P I/p 1/p 
ax) =f). L/P») dr) dy. 
Y x 


([|[ to.ne 


Prove this inequality, assuming that p > 1, that X and Y are measurable subsets 
(for example, intervals in R” and R” respectively), and that the right-hand side of 
the inequality is finite. 

b) By applying the generalized Minkowski inequality to the convolution f x g, 
show that the relation || f * g\lp < || fll1 - llgllp holds for p = 1, where, as always, 
lel p = fpr el? x) dxy!/?. 

c) Let gy € C§) (R", R) with 0 < g(x) < 1 on R” and fa, g(x) dx = 1. Assume 
that g,(x) = i o(4) and f, := f * @- for e > 0. Show that if f € R,(R") (that is, 
if the integral Tie | f |? (x) dx exists), then f. € C‘©)(IR", R) and fellp < lf llp- 

We note that the function f, is often called the average of the function f with 
kernel Qe. 

d) Preserving the preceding notation, verify that the relation 


Ife — Fllp. S sup [lta f — fllp.s, 
|h|<e 


holds on every interval J C R”, where ||u|| p,7 = ar |u|? (x) dx)!/P and ty f(x) = 
fx—h). 

e) Show that if f €¢ Rp, (R"), then ||t f — f\lp,r > Oash — 0. 

f) Prove that || fellp < ll fllp and || fe — fllp > 0 as e > +0 for every function 
fERp(R"), p> 1. 

g) Let R,(G) be the normed vector space of functions that are absolutely inte- 
grable on the open set G C R” with the norm || ||p,G. Show that the functions of 
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class CO) (G)NR p(G) form an everywhere-dense subset of ,(G) and the same 
is true for the set c&)(G) AR)(G). 

h) The following proposition can be compared with the case p = oo in the pre- 
ceding problem: Every continuous function on G can be uniformly approximated 
on G by functions of class C‘°)(G). 

i) If f is a T-periodic locally absolutely integrable function on R, then, setting 
lf llp.7 = de | f|?(x) dx)!/P, we shall denote the vector space with this norm 
by R/,. Prove that || fe — fllp.r > 0 as e > +0. 

j) Using the fact that the convolution of two functions, one of which is peri- 
odic, is itself periodic, show that the smooth periodic functions of class C (©) are 
everywhere dense in Re 


6. a) Preserving the notation of Example 11 and using formula (17.83), verify that 
if f ¢C (R"\S), then 


oy af of 
axiaxi [+ \+5 axJ (C/)s cosaids) + (s5r7) cosas 


b) Show that the sum a 26 Fs cosa; equals the jump rs )s of the nor- 
mal derivative of the function f at the corresponding point x € S, this j jump being 
L + ap )(x) of 
the normal derivatives of f at the point x from the two sides of the surface S. 

c) Verify the relation 


0 0 
Af ={Af} + (r65Z) as “ jn (F595); 


where i is the normal derivative, that is, (ZF, ¢) :=—-(F, ae) and (J f)s is the 
jump of the function f at the point x € S in the direction of the normal n. 
d) Using the expression just obtained for Af, prove the classical Green’s for- 


mula 
= af 
[crae-vanar= [(r2 - 054) do 


under the assumption that G is a finite domain in R” bounded by a piecewise- 
smooth surface S; f and g belong to C (G) A C®(G), and the integral on the 
left-hand side exists, possibly as an improper integral. 
e) Show that if the 5-function corresponds to a unit charge located at the origin 
a6 


0 in R", and the function — 3,1 corresponds to a dipole with electric moment +1 


located at 0 and oriented along the x!-axis (see Problem Ile) of Sect. 17.4) and 
the function v(x)ds is the single layer corresponding to a on distribution over 
the surface S with surface density v(x), then the function — > 2 (v(x)é s), called the 
double layer, corresponds to a distribution of dipoles over the. surface S oriented by 
the normal n and having surface density moment v(x). 
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f) Setting g = in Green’s formula and using the result of Example 14, 


|x— = 
show that every harmonic function f in the domain G in the class C“!)(G) can be 
represented as the sum of a single-layer and a double-layer potential located on the 
boundary S of G. 


7. a) The function — is the potential of the electric field intensity A = — 


x 
7 cre- 
I E 


|x 
ated in R? by a unit charge located at the origin. We also know that 


: x ; qx . q 
div| ——; } =426, div(| ——, }] =474q6, div grad{| — ]} = 476. 
|x| |x| |x| 


Starting from this, explain why it was necessary to assume that the function 
UG) =] fah must satisfy the equation AU = —4zry. Verify that it does in- 
deed satisfy the Poisson equation written here. 

b) A physical corollary of the Gauss—Ostrogradskii formula, known in electro- 
magnetic field theory as Gauss’ theorem is that the flux across a closed surface S of 
the intensity of the electric field created by charges distributed in R* equals Q/e9 
(see pp. 279 and 280), where Q is the total charge in the region bounded by the 
surface S'. Prove this theorem of Gauss. 


8. Verify the following equalities, understood in the sense of the theory of general- 
ized functions. 


a) AE =6, if 
az In|x| for x € R?, 
E= PG) —n—-2 Dn 

— FAM nay | forx €R",n>2. 


b) (A4+R)E =8, if E(x) =— ran or if E(x) = —S— 


c) LD, E=6, where =e ag? (so)? ++: +652 


Ta an and x € R?. 
7], and FE = —2@t be) _ 


at? ax" . Qman/a2t?—|x|? 
for x €R? or E= 79 $5, = $5 (ar? — |x|) for x € R3, re R. Here H(t) is 


the Heaviside function, S,,; = {x € R? | |x| = at} is a sphere, and a > 0. 

d) Using the preceding results, present the solution of the equation Au = f for 
the corresponding differential operator A in the form of the convolution f * E and 
verify, for example, assuming the function f continuous, that the integrals depend- 
ing on a parameter that you have obtained indeed satisfy the equation Au = f. 


9. Differentiation of an integral over a liquid volume. 

Space is filled with a moving substance (a liquid). Let v = v(t, x) and p = p(t, x) 
be respectively the velocity of displacement and the density of the substance at 
time ¢ at the point x. We observe the motion of a portion of the substance filling the 
domain {29 at the initial moment of time. 


a) Express the mass of the substance filling the domain (2; obtained from {2p at 
time f and write the law of conservation of mass. 
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b) By differentiating the integral F(t) = i 2, f(t,x)d@ with variable do- 
main of integration 92, (the volume of liquid), show that F’(t) = if Q, w de + 
tae, f (v,n) do, where §2;, 0S2;, dw, do,n, v, (,) are respectively the domain, its 
boundary, the element of volume, the element of area, the unit outward normal, the 
flow velocity at time ¢ at corresponding points, and the inner product. 

c) Show that F’(t) in problem b) can be represented in the form F’(t) = 
Jo, + div(fv)) do. 

‘d) Coepene the results of problems a), b), and c), obtain the equation of con- 
tinuity 4 ue + div(pv) = 0. (In this connection, see also Sect. 14.4.2.) 


e) Let |§2;| be the volume of the domain (2;. Show that Aer _ =f, 9, divude. 

f) Show that the velocity field v of the flow of an jticompecseible liquid is 
divergence-free (div v = 0) and that this condition is the mathematical expression 
of the incompressibility (conservation of volume) of any portion of the evolving 
medium. 

g) The phase velocity field (p, g) of a Hamiltonian en of classical mechan- 
ics satisfies the Hamilton equations p = =F q= a where H = H(p,q) is 
the Hamiltonian of the system. Following Liouville, show that a Hamiltonian flow 
preserves the phase volume. Verify also that the Hamiltonian H (energy) is constant 
along the streamlines (trajectories). 


Chapter 18 
Fourier Series and the Fourier Transform 


18.1 Basic General Concepts Connected with Fourier Series 


18.1.1 Orthogonal Systems of Functions 


a. Expansion of a Vector in a Vector Space 


During this course of analysis we have mentioned several times that certain classes 

of functions form vector spaces in relation to the standard arithmetic operations. 

Such, for example, are the basic classes of analysis, which consist of smooth, contin- 

uous, or integrable real-, complex-, or vector-valued functions on a domain X C R”. 
From the point of view of algebra the equality 


f=ar fit +n fn, 


where f, fi,..., fn are functions of the given class and a; are coefficients from 
R or C, simply means that the vector f is a linear combination of the vectors 
Si,---» fn of the vector space under consideration. 

In analysis, as a rule, it is necessary to consider “infinite linear combinations” — 
series of functions of the form 


f= ion fe: (18.1) 
k=1 


The definition of the sum of the series requires that some topology (in particular, 
a metric) be defined in the vector space in question, making it possible to judge 
whether the difference f — S,, tends to zero or not, where S, = A a fk: 

The main device used in classical analysis to introduce a metric on a vector space 
is to define some norm of a vector or inner product of vectors in that space. Sec- 
tion 10.1 was devoted to a discussion of these concepts. 

We are now going to consider only spaces endowed with an inner product (which, 
as before, we shall denote (, )). In such spaces one can speak of orthogonal vectors, 
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orthogonal systems of vectors, and orthogonal bases, just as in the case of three- 
dimensional Euclidean space familiar from analytic geometry. 


Definition 1 The vectors x and y in a vector space endowed with an inner product 
(,) are orthogonal (with respect to that inner product) if (x, y) =0. 


Definition 2 The system of vectors {x,; k € K} is orthogonal if the vectors in it 
corresponding to different values of the index k are pairwise orthogonal. 


Definition 3 The system of vectors {eg; k € K} is orthonormalized (or orthonor- 
mal) if (e;,e;) = 4;,; for every pair of indices i, j € K, where 6;,; is the Kronecker 


symbol, that is, 6;,; = { 1, if i=j, 


0, if iXj. 
Definition 4 A finite system of vectors x;,...,x, is linearly independent if the 
equality a}x1 +a2x2+---+Q,X, = Ois possible only when a; = a2 =--- =a, =0 


(in the first equality 0 is the zero vector and in the second it is the zero of the 
coefficient field). 

An arbitrary system of vectors of a vector space is a system of linearly indepen- 
dent vectors if every finite subsystem of it is linearly independent. 


The main question that will interest us now is the question of expanding a vector 
in a given system of linearly independent vectors. 

Having in mind later applications to spaces of functions (which may be infinite- 
dimensional as well) we must reckon with the fact that such an expansion may, in 
particular, lead to a series of the type (18.1). That is precisely where analysis enters 
into the study of the fundamental and essentially algebraic question we have posed. 

As is known from analytic geometry, expansions in orthogonal and orthonormal 
systems have many technical advantages over expansions in arbitrary linearly inde- 
pendent systems. (The coefficients of the expansion are easy to compute; it is easy to 
compute the inner product of two vectors from their coefficients in an orthonormal 
basis, and so on.) 

It is for that reason that we shall be mainly interested in expansions in orthonor- 
mal systems. In function spaces these will be expansions in orthogonal systems of 
functions or Fourier! series, to the study of which this chapter is devoted. 


!J.-B.J. Fourier (1768-1830) — French mathematician. His most important work Théorie analy- 
tique de la chaleur (1822) contained the heat equation derived by Fourier and the method of sepa- 
ration of variables (the Fourier method) of solving it (see p. 510). The key element in the Fourier 
method is the expansion of a function in a trigonometric (Fourier) series. Many outstanding math- 
ematicians later undertook the study of the possibility of such a representation. This, in particular, 
led to the creation of the theory of functions of a real variable and set theory, and it helped to 
promote the development of the very concept of a function. 
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Extending Example 12 of Sect. 10.1, we introduce an inner product 


(f; 8) = [oF Beav (18.2) 


on the vector space #2(X,C) consisting of functions on the set X C R” that are 
locally square-integrable (as proper or improper integrals). 

Since | f-g| < 5 (| f\? + |g|), the integral in (18.2) converges and hence defines 
(f, g) unambiguously. 

If we are discussing real-valued functions, relation (18.2) in the real space 
R2(x, R) reduces to the equality 


(fe iE (f - e)(x)dx. (18.3) 


Relying on properties of the integral, one can easily verify that all the axioms for 
an inner product listed in Sect. 10.1 are satisfied in this case, provided we identify 
two functions that differ only on a set of n-dimensional measure zero. Throughout 
the following, in the text portion of the section, inner products of functions will be 
understood in the sense of Eqs. (18.2) and (18.3). 


Example I We recall that for integers m and n 


as . 
i] elM® gk dy — {5 i ae (18.4) 


’ 
= 2x, ifm=n; 


i 0, ifm #n, 
i cosmxcosnxdx= 42, ifm=n40, (18.5) 
—% 2x, ifm=n=0; 

cs 
i cosmx sinnx dx = 0; (18.6) 
—T 

Oo : ro 0, ifmsAn, 18.7 
[sins sins — fms 0. (18.7) 


These relations show that {e'"*;n € Z} is an orthogonal system of vectors in 
the space R2([—7, 2], C) relative to the inner product (18.2) and the trigonometric 
system {1, cosnx, sinnx; n € N} is orthogonal in R2([—z, z], R). If we regard the 
trigonometric system as a set of vectors in R2([—z, 7], C), that is, if we allow 
linear combinations of them to have complex coefficients, then by Euler’s formulas 
e”™* = cosnx +i sinnx, cosnx = 5 (ein +e "*) sinnx = x (el —e!"*) we see 
that these two systems can be expressed linearly in terms of each other, that is, they 
are algebraically equivalent. For that reason the exponential system {e’”*; n € Z} is 
also called the trigonometric system or more precisely the trigonometric system in 
complex notation. 
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Relations (18.4)-(18.7) show that these systems are orthogonal, but not normal- 
ized, while the systems {el n € Z} and 


1 1 
cosnx, sinnx;n € n| 
ay Va Te 


are orthonormal. 

If the closed interval [—7r, 7] is replaced by an arbitrary closed interval [—/, 1] C 
R, then by a uoHenee ot variable one can obtain the analogous systems {e! THe Z} 
and {1, cos + 7nx, sin T Znx;n € N}, which are orthogonal in the spaces R2([—/, /], C) 
and R2([—/, /], R) and also the corresponding orthonormal systems 


: eT". n eZ! and : : cos 7 : snr N 
— in : Ss —nx, nxin . 
S21 Vp) nN | ee | | 


Example 2 Let I, be an interval in R” and J, an interval in R”, and let { f;(x)} be 
an orthogonal system of functions in R2(/;, R) and {g;(y)} an orthogonal system 
of functions in R2(/y, IR). Then, as follows from Fubini’s theorem, the system of 
functions {u;;(x, y):= fj (x)gj(y)} is orthogonal in R2U x Ty, R). 


Example 3 We remark that for a 4 6 


r 1 (me —p)l  sin(a+ pi) 
i; sinax sin Bx dx = 5 = 
0 


a—B a+ B 
tanal — a tan Bl 
=eewiconere! suse ot ; 
— p2 


Hence, if a and 6 are such that , the original integral equals zero. 
Consequently, if &) < & <---< -_ +++ 1S a sequence of roots of the equa- 
tion tané/ = c&, where c is an arbitrary constant, then the system of functions 
{sin(&,x);n € N} is orthogonal on the interval [0,/]. In particular, for c = 0, we 
obtain the familiar system {sin(F nx); née N}. 


uel ol __ tan BL 
SB 


Example 4 Consider the equation 


d2 
(a 5+ a(x) )u(s) = = du(x), 


where g € C Coo} fia, b], R) and d is a numerical coefficient. Let us assume that the 
functions u1,u2,... are of class C (fa, b], R) and vanish at the endpoints of the 
closed interval [a, b] and that each of them satisfies the given equation with partic- 
ular values A}, A2,... of the coefficient A. We shall show that if 4; 4 4;, then the 
functions u; and u; are orthogonal on [a, b]. 
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Indeed, integrating by parts, we find that 


b d2 b d2 
[| (Gar 2)ueo|useoar= f wico| ($5 +400 Jason fa. 


According to the equation, we obtain from this the relation 
Aj (Uj, Uj) =Aj (Ui, Uj); 


and, since A; # 4;, we now conclude that (u;, u;) = 0. 
In particular, if g(x) =0 on [a, b] and [a, b] = [0,7] we again find that the 
system {sinnx; n € N} is orthogonal on [0, z]. 


Further examples, including examples of orthogonal systems of importance in 
mathematical physics, will be found in the problems at the end of this section. 


c. Orthogonalization 


It is well-known that in a finite-dimensional Euclidean space, starting with a lin- 
early independent system of vectors, there is a canonical way of constructing an 
orthogonal and even orthonormal system of vectors equivalent to the given system, 
using the Gram?—Schmidt? orthogonalization process. By the same method one can 
obviously orthonormalize any linearly independent system of vectors w1, y2,... in 
any vector space having an inner product. 

We recall that the orthogonalization process leading to the orthonormal system 
(1, $2,... 18 described by the following relations: 


= WI i wo — (Wr, 91) G1 
Wall IIo — (Wo, ei) Gr 


_ Wn _ ee, (Wn, Pk) Pk 
In — 71 (Wins Pk) GE 


YI 


Pn 


Example 5 The process of orthogonalizing the linearly independent system {1, x, 
x’,...} in R2({—1, 1], R) leads to the system of orthogonal polynomials known as 
the Legendre polynomials. We note that the name Legendre polynomials is often 
given not to the orthonormal system, but to a system of polynomials proportional 


?J.P. Gram (1850-1916) — Danish mathematician who continued the research of P.L. Chebyshev 
and exhibited the connection between orthogonal series expansions and the problem of best least- 
squares approximation (see Fourier series below). It was in these investigations that the orthogo- 
nalization process and the famous Gram matrix arose (see p. 187 and the system (18.18) on p. 504). 


3E. Schmidt (1876-1959) — German mathematician who studied the geometry of Hilbert space in 
connection with integral equations and described it in the language of Euclidean geometry. 
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to these polynomials. The proportionality factor can be chosen from various con- 
siderations, for example, requiring the leading coefficient to be | or requiring the 
polynomial to have the value | at x = 1. The orthogonality of the system is unaf- 
fected by these requirements, but in general orthonormality is lost. 

We have already encountered the standard Legendre polynomials, which are de- 
fined by Rodrigues’ formula 


Lidtige =)? 


PaO) = Tom aga 


For these polynomials P,,(1) = 1. Let us write out the first few Legendre polynomi- 
als, normalized by requiring the leading coefficient to be 1: 


2 _ 7 ae ; 
Past, A@=x, Pax—3, Pax? — ox. 


The orthonormalized Legendre polynomials have the form 


where n = 0, 1,2,.... 

One can verify by direct computation that these polynomials are orthogonal on 
the closed interval [—1, 1]. Taking Rodrigues’ formula as the definition of the poly- 
nomial P,,(x), let us verify that the system of Legendre polynomials {P,,(x)} is 
orthogonal on the closed interval [—1, 1]. To do this, it suffices to verify that P,, (x) 
is orthogonal to 1, x,...,x”7!, since all polynomials P; of degree k <n are linear 
combinations of these. 

Integrating by parts for k <n, we indeed find that 


dx =0. 


1 1 dkt+1yk d?—k-1 (x2 _ 1)" 
kok [ dxk+1 : dx2—-k-1 


1 
i x* P(x) dx = 
-1 


A certain picture of the origin of orthogonal systems of functions in analysis will 
be given in the last subsection of this section and in the problems at the end of the 
section. At present we shall return to the fundamental general problems connected 
with the expansion of a vector in terms of vectors of a given system of vectors in a 
vector space with inner product. 


d. Continuity of the Inner Product and the Pythagorean Theorem 


We shall have to work not only with finite sums of vectors but also with infinite sums 
(series). In this connection we note that the inner product is a continuous function, 
enabling us to extend the ordinary algebraic properties of the inner product to the 
case of series. 
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Let X be a vector space with an inner product (, ) and the norm it induces ||x || := 
J (x,x,) (see Sect. 10.1). Convergence of a series yy x; =x of vectors xj € X 
to the vector x € X will be understood in the sense of convergence in this norm. 


Lemma 1 (Continuity of the inner product) Let (,) : X — C be an inner product in 
the complex vector space X. Then 


a) the function (x, y) > (x, y) is continuous jointly in the two variables; 


b) ifx = Yo) x, then (x, y) = DP (x,y) 
c) if e1,e2,..., is an orthonormal system of vectors in X and x = ae x! e; 


and y = )-°°, y'e;, then (x, y) = oe x'y’. 


Proof Assertion a) follows from the Cauchy—Bunyakovskii inequality (see 


Sect. 10.1): 
7) 
| (x — x0, y — yo) |" < lle — xoll?- lly — voll’. 
Assertion b) follows from a), since 


n 


C=) ao. yo eae) 


i=l i=n+l 


and pare xj > Oasn— oo. 
Assertion c) follows by repeated application of b), taking account of the relation 


(x,y) = (y, x). 


The following result is an immediate consequence of the lemma. 


Theorem 1 (Pythagoras*) 


a) If {x;} is a system of mutually orthogonal vectors and x = )°, x;, then ||x |? = 


Y; bell”. 


b) If {e:} is an orthonormalized system of vectors and x =)"; x!e;, then ||x||7 = 


>; xl, 


18.1.2 Fourier Coefficients and Fourier Series 


a. Definition of the Fourier Coefficients and the Fourier Series 


Let {e;} be an orthonormal system and {/;} an orthogonal system of vectors in a 
space X with inner product (, ). 


4Pythagoras of Samos (conjectured to be 580-500 BCE) — famous ancient Greek mathematician 
and idealist philosopher, founder of the Pythagorean school, which, in particular, made the dis- 
covery that the side and diagonal of a square are incommensurable, a discovery that disturbed the 
ancients. The classical Pythagorean theorem itself was known in a number of countries long before 
Pythagoras (possibly without proof, to be sure). 
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Suppose that x = )°; x'l;. The coefficients x! in this expansion of the vector x 
can be found directly: 


a (x, li) 


If 1; = e;, the expression becomes even simpler: 
i 
Xx’ = (x, ej). 


We remark that the formulas for x! make sense and are completely determined 
if the vector x itself and the orthogonal system {/;} (or {e;}) are given. The equal- 
ityx=), x'l; (or x = ; x'e;) is no longer needed to compute x! from these 
formulas. 


Definition 5 The numbers { rt +} are the Fourier coefficients of the vector x € X 
in the orthogonal system {l;}. 

If the system {e;} is orthonormal, the Fourier coefficients have the form {(x, e;)}. 

From the geometric point of view the ith Fourier coefficient (x, e;) of the vector 
x € X is the projection of that vector in the direction of the unit vector e;. In the 
familiar case of three-dimensional Euclidean space E* with a given orthonormal 
frame ¢1, €2, e3 the Fourier coefficients x! = (x, e;), i = 1, 2,3, are the coordinates 
of the vector x in the basis e1, e2, e3 appearing in the expansion x = xtey +x7e7 4 
x3e3. 

If we were given only the two vectors e; and e2 instead of all three e1, e2, e3, the 
expansion x = x!e; + xe) in this system would certainly not be valid for all vec- 
tors x € E>. Nevertheless, the Fourier coefficients x’ = (x,e;), i = 1,2, would be 
defined in this case and the vector xe = x!e, + x*e2 would be the orthogonal projec- 
tion of the vector x onto the plane L of the vectors e; and e2. Among all the vectors 
in that plane, the vector x¢ is distinguished by being closest to x in the sense that 
|x — y|| = |lx — xe|| for any vector y € L. This is the remarkable extremal property 
of the Fourier coefficients, to which we shall return below in the general situation. 


Definition 6 If X is a vector space with inner product (,) and J), lo,...,Jn,... is 
an orthogonal system of nonzero vectors in X, then for each vector x € X one can 
form the series 


x~>> slips (18.8) 


toy (lk Ek) 
This series is the Fourier series of x in the orthogonal system {lx}. 
If the system {/;,} is finite, the Fourier series reduces to its finite sum. 


In the case of an orthonormal system {e;} the Fourier series of a vector x € X 
has a particularly simple expression: 


lee) 
x~ Str, exer. (18.8) 
k=1 
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Example 6 Let X = R({—7, 7], R). Consider the orthogonal system 
{1, coskx, sinkx; k € N} 


of Example 1. To the function f € R2([—7, 2], R) there corresponds a Fourier 
series 


fr aD r Geol + by(f) sinkx 


k=1 


in this system. The coefficient 4 z is included in the zeroth term so as to give a uni- 
fied appearance to the following formulas, which follow from the definition of the 
Fourier coefficients: 


1s 


1 
a(f)=—]  f(x)coskxdx, k=0,1,2,... (18.9) 


nif) == ” Popankeds. se ee (18.10) 


— 


Let us set f(x) =x. Then a = 0, k=0,1,2,..., and by = (-1)**12, k= 
1,2,.... Hence in this case we obtain 


f)ex~ Dept! : sinkx. 


k=1 


Example 7 Let us consider the orthogonal system {e!**; k € Z} of Example | in 

the space R2([—7z, 1], C). Let f € R2([—7, 2], C). According to Definition 5 and 

relations (18.4), the Fourier coefficients {c,(f)} of f in the system {el} are ex- 
pressed by the following formula: 

L 7 ik aoe) 

a=s f fore i qx(= Lor? (18.11) 

Comparing Eqs. (18.9), (18.10), and (18.11) and taking account of Euler’s for- 

mula e!? = cosy +i sing, we obtain the following relations between the Fourier 

coefficients of a given function in the trigonometric systems written in real and 

complex forms: 


(ae — idk), if k= 0, 
Ck=) 4 (18.12) 
x(a-x+ib_x), ifk <0. 
In order that the case k = 0 not be an exception in formulas (18.9) and (18.12), 
it is customary to use ag to denote not the Fourier coefficient itself, but rather its 
double, as was done above. 
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b. Basic General Properties of Fourier Coefficients and Series 
The following geometric observation is key in this section. 


Lemma (Orthogonal complement) Let {lx} be a finite or countable system of 
nonzero pairwise orthogonal vectors in X, and suppose the Fourier series of x € X 
in the system {lx} converges to xj € X. 

Then in the representation x = x; +h the vector h is orthogonal to x1; moreover, 
h is orthogonal to the entire linear subspace generated by the system of vectors {lx}, 
and also to its closure in X. 


Proof Taking account of the properties of the inner product, we see that it suffices 
to verify that (h, lm) = 0 for every Im € {Ix}. 
We are given that 


’ 


(x, Uk) 
h=x-xj=x lk. 
ps (lk, lk) 
Hence 


(x, lm) 
h, ln) l = = (x,lm) — lms lm) = 0. 
(h, lm) (x, lm) - i mt (x, lm) a oe (lin, lm) 


Geometrically this lemma is transparent, and we have already essentially pointed 
it out when we considered a system of two orthogonal vectors in three-dimensional 
Euclidean space in Sect. 18.1.2a. 

On the basis of this lemma we can draw a number of important general conclu- 
sions on the properties of Fourier coefficients and Fourier series. 


Bessel’s Inequality 


Taking account of the orthogonality of the vectors x; and h in the decomposition 
x =x, +A, we find by the Pythagorean theorem that |].x ||? = |]x7|]7 + [|All]? = llazll? 
(the hypotenuse is never smaller than the leg). This relation, written in terms of 
Fourier coefficients, is called Bessel’s inequality. 

Let us write it out. By the Pythagorean theorem 


lz? = >> 


k 


Gales 
(Ux, Uk) 


te i) (18.13) 


Hence 


eto P 2 
—_— : 18.14 
D i“ Teal (18.14) 
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This is Bessel’s inequality. It has a particularly simply appearance for an or- 
thonormal system of vectors {e;}: 


S-|(x, ex) |” < Hall. (18.15) 
k 


In terms of the Fourier coefficients a; themselves Bessel’s inequality (18.14) can 
be written as )>, lax |* [Ze]? < |]x||?, which in the case of an orthonormal system 
reduces to )-, |ax|? < ||x||?. 

We have included the absolute value sign in the Fourier coefficient, since we are 
allowing complex vectors spaces X. In this case the Fourier coefficient may assume 
complex values. 

We note that in deriving Bessel’s inequality we made use of the assumption that 
the vector x; exists and that Eq. (18.13) holds. But if the system {/;} is finite, there 
is no doubt that the vector x; does exist (that is, that the Fourier series converges 
in X). Hence inequality (18.14) holds for every finite subsystem of {/;}, and then it 
must hold for the whole system as well. 


Example 8 For the trigonometric system (see formulas (18.9) and (18.10)) Bessel’s 
inequality has the form 


Lice + ax(f)|" + |be(f)|? <- | lf? (x) de. (18.16) 


For the system {el*- k € Z} (see formula (18.11)) Bessel’s inequality can be 
written in a particularly elegant form: 


+00 


lanl s aa If 1? (x) de. (18.17) 
20 


—co 


Convergence of Fourier Series in a Complete Space 


Suppose ye xke = ye (x, ex)ex is the Fourier series of the vector x € X in the 
orthonormal system {e,}. By Bessel’s inequality (18.15) the series }°, |x* |? con- 
verges. By the Pythagorean theorem 


[2 em beet atenf = fa"? oo ft 


By the Cauchy convergence criterion for a series, the right-hand side of this 
equality becomes less than any ¢ > 0 for all sufficiently large values of m andn > m. 
Hence we then have 


|x" em pee $x" en | < Je. 
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Consequently, the Fourier series )>, x*e, satisfies the hypotheses of the Cauchy 
convergence criterion for series and therefore converges provided the original space 
X is complete in the metric induced by the norm ||x|| = /(x, x). 

To simplify the writing we have carried out the reasoning for a Fourier series in 
an orthonormal system. But everything can be repeated for a Fourier series in any 
orthogonal system. 


The Extremal Property of the Fourier Coefficients 


We shall show that if the Fourier series >, x*ex = °, eel ex of the vector x € X 
in the orthonormal system {e,} converges to a vector x; € X, then the vector x; 
is precisely the one that gives the best approximation of x among all vectors y = 


ar axex of the space L spanned by {ex}, that is, for every y € L, 


llx — xull < lle — yl, 


and equality holds only for y = x;. 
Indeed, by the orthogonal complement lemma and the Pythagorean theorem, 


Ix — yl? =|]@-—2) + a —y) | = |r t+ —y)|7 = 
= lhl? + llr — yl? = Wall? = Ix — al”. 


Example 9 Digressing slightly from our main purpose, which is the study of ex- 
pansions in orthogonal systems, let us assume that we have an arbitrary system of 
linearly independent vectors x;,...,x, in X and are seeking the best approxima- 
tion of a given vector x € X by linear combinations )~;_, a,x, of vectors of the 
system. Since we can use the orthogonalization process to construct an orthonormal 
system e€1,...,é@, that generates the same space L that is generated by the vectors 
X1,...,X,, we can conclude from the extremal property of the Fourier coefficients 
that there exists a unique vector x; € L such that ||x — x;|| =infyez ||x — y|l. Since 
the vector h = x — x; is orthogonal to the space L, from the equality x; +h =x we 
obtain the system of equations 


(X1, X1)Oy +++ + (Xn, X1) An = (x, X1), 


: (18.18) 
(X1,Xn)Oy +++ + (Xn, Xn) On = (X, Xn) 
for the coefficients a@1,...,@, of the expansion x; = pe 1 %x_ Of the unknown 
vector x; in terms of the vectors of the system x1, ..., X,. The existence and unique- 


ness of the solution of this system follow from the existence and uniqueness of the 
vector x;. In particular, it follows from this by Cramer’s theorem that the determi- 
nant of this system is nonzero. In other words, we have shown as a by-product that 
the Gram determinant of a system of linearly independent vectors is nonzero. 
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This approximation problem and the system of Eqs. (18.18) corresponding to it 
arise, as we have already noted, for example, in processing experimental data by 
Gauss’ least-squares method. (See also Problem 1.) 


c. Complete Orthogonal Systems and Parseval’s Equality 


Definition 7 The system {xg;a@ € A} of vectors of a normed space X is complete 
with respect to the set E C X (or complete in F) if every vector x € E can be 
approximated with arbitrary accuracy in the sense of the norm of X by finite linear 
combinations of vectors of the system. 


If we denote by L {xq} the linear span in X of the vectors of the system (that is, 
the set of all finite linear combinations of vectors of the system), Definition 7 can be 
restated as follows: 

The system {xq} is complete with respect to the set E C X if E is contained in 
the closure L{x,} of the linear span of the vectors of the system. 


Example 10 If X = E? and e}, eo, e3 is a basis in E?, then the system {€1, €2, €2} is 
complete in X. The system {e,, e2} is not complete in X, but it is complete relative 
to the set L{e), e2} or any subset E of it. 


Example 11 Let us regard the sequence of functions 1, x,x7,... as a system of 
vectors {x*; k=0,1,2,...} in the space R2([a, b], R) or R2((a, b], C). If Cla, b] 
is a subspace of the continuous functions, then this system is complete with respect 


to the set C[a, b]. 


Proof Indeed, for any function f € Cla, b] and for every number ¢ > 0, the Weier- 
strass approximation theorem implies that there exists an algebraic polynomial P(x) 
such that maxyefa,p] | f(x) — P(x)| < e. But then 


b 
lf — Pll:= \/ |f — PP) dx <evb—a 


and hence one can approximate the function f° in the sense of the norm of the space 
R2([a, b]) with arbitrary accuracy. 


We note that, in contrast to the situation in Example 9, in the present case not 
every continuous function on the closed interval [a, b] is a finite linear combination 
of the functions of this system; rather, such a function can only be approximated 
by such linear combinations. Thus C[a, b] C L{x"} in the sense of the norm of the 
space R2[a, b]. 


Example 12 If we remove one function, for example the function 1, from the system 
{1, coskx, sinkx; k € N}, the remaining system {coskx, sinkx; k € N} is no longer 
complete in R2([—z, 2], C) or R2([—z, z], R). 
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Proof Indeed, by the extremal property of the Fourier coefficients the best approxi- 
mation of the function f(x) = 1 among all the finite linear combinations 


n 
Ty (x) = Ya coskx + by sinkx) 
k=1 


of any length n is given by the trigonometric polynomial T,,(x) in which ax and bx 
are the Fourier coefficients of the function 1 with respect to the orthogonal system 
{coskx, sinkx; k € N}. But by relations (18.5), such a polynomial of best approxi- 
mation must be zero. Hence we always have 


ie 
[1 — Trl = Wl = i] Idx = V2z > 0, 
— 


and it is impossible to approximate | more closely than ./2z by linear combinations 
of functions of this system. 


Theorem (Completeness conditions for an orthogonal system) Let X be a vector 
space with inner product {, ), and 1,,12,...,[n,... a finite or countable system of 
nonzero pairwise orthogonal vectors in X. Then the following conditions are equiv- 
alent: 


a) the system {Ix} is complete with respect to the set? E C X; 
b) for every vector x € E C X the following (Fourier series) expansion holds: 


(x, le) 
x= Ik; (18.19) 
dX (ste) 
c) for every vector x € E C X Parseval’s® equality holds: 
2 I(x, lk)? 
x||F = ————, (18.20) 
allen arc 


Equations (18.19) and (18.20) have a particularly simple form in the case of an 
orthonormal system {e;}. In that case 


x=) (x, exer (18.19’) 
k 
and 
In = Do] (x, ex)”. (18.20) 
k 


5The set E may, in particular, consist of a single vector that is of interest for one reason or another. 


6M.A. Parseval (1755-1836) — French mathematician who discovered this relation for the trigono- 
metric system in 1799. 
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Thus the important Parseval equality (18.20) or (18.20’) is the Pythagorean the- 
orem written in terms of the Fourier coefficients. 
Let us now prove this theorem. 


Proof a) => b) by virtue of the extremal property of Fourier coefficients; 

b) > c) by the Pythagorean theorem; 

c) => a) since by the lemma on the orthogonal complement (see Sect. b) above) 
the Pythagorean theorem implies 


ip) "ky, | "ed? 
x— i.) = (xi? a he| = (|x|? — eae 
aren I ay tt] = WP 2a 


=I k=1 k=1 


Remark We note that Parseval’s equality implies the following simple necessary 
condition for completeness of an orthogonal system with respect toaset E CX: E 
does not contain a nonzero vector orthogonal to all the vectors in the system. 


As a useful supplement to this theorem and the remark just made, we prove the 
following general proposition. 


Proposition Let X be a vector space with an inner product and x), X2,...a system 
of linearly independent vectors in X. In order for the system {xx} to be complete 
in X, 


a) a necessary condition is that there be no nonzero vector in X orthogonal to 
all the vectors in the system; 

b) if X is a complete (Hilbert) space, it suffices that X contain no nonzero vector 
orthogonal to all the vectors in the system. 


Proof a) If the vector h is orthogonal to all the vectors in the system {x;,}, we con- 
clude by the Pythagorean theorem that no linear combination of vectors in the sys- 
tem can differ from h by less than ||h||. Hence, if the system is complete, then 
I[h\| = 0. 

b) By the orthogonalization process we can obtain an orthonormal system {ex} 
whose linear span L{e;} is the same as the linear span L{x;} of the original system. 

We now take an arbitrary vector x € X. Since the space X is complete, the Fourier 
series of x in the system {ex} converges to a vector x. € X. By the lemma on the 
orthogonal complement, the vector h = x — xe is orthogonal to the space L{e,} = 
L{xx}. By hypothesis = 0, so that x = xe, and the Fourier series converges to the 
vector x itself. Thus the vector x can be approximated arbitrarily closely by finite 
linear combinations of vectors of the system {e,} and hence also by finite linear 
combinations of the vectors of the system {xx}. 


The hypothesis of completeness in part b) of this proposition is essential, as the 
following example shows. 
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Fig. 18.1 


h © eo =heX 


Example 13 Consider the space /> (see Sect. 10.1) of real sequences a = Ce" ics) 
for which a (a/)? < 00. We define the inner product of the vectors a = 
(a',a*,...) and b = (b!, b?,....) in /y in the standard way: (a, b) := ae al bs, 
Now consider the orthonormal system e, = (0,...,0,1,0,0,...), k=1,2,.... 
————" 


k 
The vector e9 = (1,0,0,...) does not belong to this system. We now add to the 
system {ez; k € N} the vector e = (1, 1/2, 72. ie: ...) and consider the linear 
span L{e,e1,e2,...} of these vectors. We can regard this linear span as a vector 
space X (a subspace of /2) with the inner product from /9. 
We note that the vector e9 = (1, 0, 0, .. .) obviously cannot be obtained as a finite 


linear combination of vectors in the system e, e;, €2,..., and therefore it does not 
belong to X. At the same time, it can be approximated as closely as desired in /2 by 
such linear combinations, since e — eel Eek =(1,0,...,0, sat rae wae) 


Hence we have established simultaneously that X is not closed in /2 (and there- 
fore X, in contrast to /2, is not a complete metric space) and that the closure of X in 
ly coincides with /2, since the system eo, e1, €2,... generates the entire space /2. 

We now observe that in X = L{e, e), e2, ...} there is no nonzero vector orthogo- 
nal to all the vectors e1, é2,.... 

Indeed, let x € X, that is, x =ae+ paar, apex, and let (x, ex) =0,k =1,2,.... 


Then (x, €n41) = at = 0, that is, a = 0. But then a, = (x, eg) =0,k=1,...,n. 
Hence we have constructed the required example: the orthogonal system 
€1,€2,... 18 not complete in X, sine it is not complete in the closure of X, which 


coincides with />. 


This example is of course typically infinite-dimensional. Figure 18.1 represents 
an attempt to illustrate what is going on. 

We note that in the infinite-dimensional case (which is so characteristic of analy- 
sis) the possibility of approximating a vector arbitrarily closely by linear combina- 
tions of vectors of a system and the possibility of expanding the vector in a series of 
vectors of the system are in general different properties of the system. 

A discussion of this problem and the concluding Example 14 will clarify the 
particular role of orthogonal systems and Fourier series for which these properties 
hold or do not hold simultaneously (as the theorem proved above shows). 


Definition 8 The system x1, x2,...,Xn,... of vectors of a normed vector space X 
is a basis of X if every finite subsystem of it consists of linearly independent vectors 
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and every vector x € X can be represented as x = )°, axx, where ay are coeffi- 
cients from the scalar field of X and the convergence (when the sum is infinite) is 
understood in the sense of the norm on X. 


How is the completeness of a system of vectors related to the property of being 
a basis? 

In a finite-dimensional space X completeness of a system of vectors in X, as 
follows from considerations of compactness and continuity, is obviously equivalent 
to being a basis in X. In the infinite-dimensional case that is in general not so. 


Example 14 Consider the set C({—1, 1], R) of real-valued functions that are con- 
tinuous on [—1, 1] as a vector space over the field R with the standard inner product 
defined by (18.3). We denote this space by C2([—1, 1], R) and consider the system 
of linearly independent vectors 1, x, x7, ... in it. 

This system is complete in C2([—1, 1], R) (see Example 11), but is not a basis. 


Proof We first show that if the series yar apx* converges in C2([{—1, 1], R), that 
is, in the mean-square sense on [—1, 1], then, regarded as a power series, it con- 
verges pointwise on the open interval ]—1, 1[. 

Indeed, by the necessary condition for convergence of a series, we have 
\|a.x* || > 0 as k > oo. But 


: 2 
Joust =f (oux!)Par =a. 


Hence |ax| < /2k + 1 for all sufficiently large values of k. In that case the power 
series ) pp a,x* definitely converges on the interval ]—1, 1. 

We now denote the sum of this power series on ]—1, 1[ by g. We remark that 
on every closed interval [a,b] C ]—1, 1[ the power series converges uniformly to 
%|{a,b]- Consequently it also converges in the sense of mean-square deviation. 

It now follows that if a continuous function f is the sum of this series in the sense 
of convergence in C2([—1, 1], R), then f and @ are equal on |—1, I[. But the func- 
tion ¢ is infinitely differentiable. Hence if we take any function in C2({[—1, 1], R) 
that is not infinitely differentiable on ]—1, 1[ it cannot be expanded in a series in the 
system {x*; k=0,1,...}. 


Thus, if we take, for example, the function x = |x| and the sequence of numbers 
{E, = ‘5 n € N}, we can construct a sequence { P, (x); n € N} of finite linear combi- 
nations P,(x) =ag +a ,x +---+a,x” of elements of the system {x*; k EN} such 
that || f — Pyl| < i, that is, P, > f asin — oo. If necessary, one could assume that 
in each such linear combination P,,(x) the coefficients can be assumed to have been 
chosen in the unique best-possible way (see Example 9). Nevertheless, the expan- 
sion f =) jo ax* will not arise since in passing from P,(x) to Pn +(x), not only 
the coefficient w,+4; changes, but also possibly the coefficients ag, ..., dn. 
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If the system is orthogonal, this does not happen (ao,...,@, do not change) 
because of the extremal property of Fourier coefficients. 

For example, one could pass from the system of monomials {x“} to the orthog- 
onal system of Legendre polynomials and expand f(x) = |x| in a Fourier series in 
that system. 


18.1.3. *An Important Source of Orthogonal Systems of Functions 
in Analysis 


We now give an idea as to how various orthogonal systems of functions and Fourier 
series in those systems arise in specific problems. 


Example 15 (The Fourier method) Let us regard the closed interval [0,/] as the 
equilibrium position of a homogeneous elastic string fastened at the endpoints of 
this interval, but otherwise free and capable of making small transverse oscillations 
about this equilibrium position. Let u(x, t) be a function that describes these oscil- 
lations, that is, at each fixed instant of time ¢ = fg the graph of the function u(x, fo) 
over the closed interval 0 < x </ gives the shape of the string at time fo. This in 
particular, means that u(0, t) = u(/,t) = 0 at every instant rt, since the ends of the 
string are clamped. 

It is known (see for example Sect. 14.4) that the function u(x, f) satisfies the 
equation 


a7u 2 a7u 

a ee 18.21 

ar ax? oe 
where the positive coefficient a depends on the density and elastic constant of the 


string. 

Equation (18.21) alone is of course insufficient to determine the function u(x, ft). 
From experiment we know that the motion u(x,t) is uniquely determined if, for 
example, we prescribe the position u(x, 0) = g(x) of the string at some time t = 0 
(which we shall call the initial instant) and the velocity Su (x, 0) = w(x) of the 
points of the string at that time. Thus, if we stretch the string into the shape g(x) 
and let it go, then w(x) =0. 

Hence the problem of free oscillations of the string’ that is fixed at the ends of 
the closed interval [0, /] has been reduced to finding a solution u(x, t) of Eq. (18.21) 
together with the boundary conditions 


u(0,t) =u(l, t) =0 (18.22) 


7We note that the foundations of the mathematical investigation of the oscillations of a string were 
laid by Brook Taylor. 
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and the initial conditions 


a 
u(x, 0) = y(x), 5 (80) = W(x). (18.23) 


To solve such problems there exists a very natural procedure called the method 
of separation of variables or the Fourier method in mathematics. It consists of the 
following. The solution u(x, t) is sought in the form of a series ae Xn(x) Tit) 
whose terms X (x)T(t) are solutions of an equation of special form (with variables 
separated) and satisfy the boundary conditions. In the present case, as we see, this 
is equivalent to expanding the oscillations u(x,t) into a sum of simple harmonic 
oscillations (more precisely a sum of standing waves). 

Indeed, if the function X(x)T(t) satisfies Eq. (18.21), then X(x)T’(t) = 
a?X"(x)T (t), that is, 

T” (t) xX” (x) 
a2T(t)  X(x)° 

In Eq. (18.24) the independent variables x and ¢ are on opposite sides of the 
equation (they have been separated), and therefore both sides actually represent the 
same constant i. If we also take into account the boundary conditions X (0)T (t) = 


X(1)T (t) = 0 that the solution of stationary type must satisfy, we see that finding 
such a solution reduces to solving simultaneously the two equations 


(18.24) 


T" (t) =Aa?T (t), (18.25) 
X" (x) =AX (x) (18.26) 


under the condition that X (0) = X (J) = 0. 
It is easy to write the general solution of each of these equations individually: 


T(t) = AcosVaat + Bsin Vat, (18.27) 
X(x) =CcosVAx + DsinVAx. (18.28) 


If we attempt to satisfy the conditions X (0) = X (/) = 0, we find that for A 4 0 we 
must have C = 0, and, rejecting the trivial solution D = 0, we find that sin Vil = 0, 
from which we find /A =+nz/I,néN. 

Thus it turns out that the number A in Eqs. (18.25) and (18.26) can be chosen only 
among a certain special series of numbers (the so-called eigenvalues of the problem), 
hn = (nmr/1)?, where n € N. Substituting these values of into the expressions 
(18.27) and (18.28), we obtain a series of special solutions 


‘ as wa . wa 
in(s.t) =sinnx( Ay cosn 4 + By sinn 1), (18.29) 


satisfying the boundary conditions u,(0, t) = u,(l, t) = 0 (and describing a stand- 
ing wave of the form ®(x) - sin(wt + @), in which each point x € [0,7] undergoes 
simple harmonic oscillations with its own amplitude ®(x) but the same frequency 
w for all points). 
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The quantities w, =n aa n &€N, are called, for natural reasons, the natural fre- 
quencies of the string, and its simplest harmonic oscillations (18.29) are called the 
natural oscillations of the string. The oscillation u(x,t) with smallest natural fre- 
quency is often called the fundamental tone of the string and the other natural fre- 
quencies u2(x,t),u3(x,t),... are called overtones (it is the overtones that form 
the sound quality, called the timbre, characteristic of each particular musical instru- 
ment). 

We now wish to represent the oscillation u(x,t) we are seeking as a sum 
ye Un(x,t) of the natural oscillations of the string. The boundary conditions 
(18.22) are automatically satisfied in this case, and we need worry only about the 
initial conditions (18.23), which mean that 


lo) 
g(x) = An sinn =x (18.30) 
n=1 
and 
woo on B, sinn— 7%: (18.31) 


Thus the problem has been reduced to finding the coefficients A, and B,, which 
up to now have been free, or, what is the same, to expanding the functions g and y 
in Fourier series in the system {sinn 7x; n € N}, which is orthogonal on the interval 
[0, Z]. 


It is useful to remark that the functions {sinn7x;n € N}, which arose from 


Eq. (18.26) can be regarded as Eien vectors of the linear operator A = a corre- 
sponding to the eigenvalues A, =n 7, which in turn arose from the condition that the 
operator A acts on the space of fanclione 4 in C0, /] that vanish at the endpoints 
of the closed interval [0,/]. Hence Eqs. (18.30) and (18.31) can be interpreted as 
expansions in eigenvectors of this linear operator. 

The linear operators connected with particular problems are one of the main 
sources of orthogonal systems of functions in analysis. 

We now recall another fact known from algebra, which reveals the reason why 
such systems are orthogonal. 

Let Z be a vector space with inner product (, ), and let E be a subspace (possibly 
equal to Z itself) that is dense in Z. A linear operator A: E — Z is symmetric 
if (Ax, y) = (x, Ay) for every pair of vectors x, y € E. Then: eigenvectors of a 
symmetric operator corresponding to different eigenvalues are orthogonal. 


Proof Indeed, if Au = au and Av = fv, anda ¥ B, then 


a(u,v) = (Au, v) = (u, Av) = Blu, v), 


from which it follows that (u, v) = 0. 
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It is now useful to look at Example 3 from this point of ae There we were 
> +4q(x)) operat- 
ing on the space of functions in C® [a, b] that vanish at the eae of the closed 
interval [a, b]. Through integration by parts one can verify that this operator is sym- 
metric on this space (with respect to the standard inner product (18.4)), so that the 
result of Example 4 is a particular manifestation of this algebraic fact. 


essentially considering the eigenfunctions of the operator A = 


In particular, when q(x) = 0 the operator A becomes - which for [a, b] = 
[0, 7] occurred in the last example (Example 15). 

We note also that in this example the question reduced to expanding the functions 
g and wy ng relations (18.30) and (18.31)) in a series of eigenfunctions of the oper- 


ator A = a . Here of course the question arises whether it is theoretically possible 
to form such an expansion, and this question is equivalent, as we now understand, 
to the question of the completeness of the system of eigenfunctions for the operator 
in question in the given space of functions. 

The completeness of the trigonometric system (and certain other particular sys- 
tems of orthogonal functions) in #2[—7, 7] seems to have been stated explicitly 
for the first time by Lyapunov. The completeness of the trigonometric system 
in particular was implicitly present in the work of Dirichlet devoted to studying 
the convergence of trigonometric series. Parseval’s equality, which is equivalent to 
completeness for the trigonometric system, as already noted, was discovered by 
Parseval at the turn of the nineteenth century. In its general form, the question of 
completeness of orthogonal systems and their application in the problems of math- 
ematical physics were one of the main subjects of the research of Steklov,’ who 
introduced the very concept of completeness (closedness) of an orthogonal sys- 
tem into mathematics. In studying completeness problems, by the way, he made 
active use of the method of integral averaging (smoothing) of a function (see 
Sects. 17.4 and 17.5), which for that reason is often called the Steklov averaging 
method. 


18.1.4 Problems and Exercises 


1. The method of least squares. The dependence y = f(x1,...,Xn) of the quantity 
y on the quantities x;,...,X, is studied experimentally. As a result of m (=n) 


8A.M. Lyapunov (1857-1918) — Russian mathematician and specialist in mechanics, a brilliant 
representative of the Chebyshev school, creator of the theory of stability of motion. He successfully 
studied various areas of mathematics and mechanics. 


°V.A. Steklov (1864-1926) — Russian/Soviet mathematician, a representative of the Petersburg 
mathematical school founded by Chebyshev and founder of the school of mathematical physics in 
the USSR. The Mathematical Institute of the Russian Academy of Sciences bears his name. 
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experiments, a table was obtained 


X{ x9 er Xn | y 
1 1 1 1 
GQ Gy t+ Ay, b 
m m m m 
ay ays a | b 
each of whose rows contains a set (Gia: ee a) of values of the parameters 


X1,X2,...,Xy, and the value b! of the quantity y corresponding to them, measured by 
some device with a certain precision. From these experimental data we would like to 
obtain an empirical formula of the form y = )7/_, ax; convenient for computation. 
The coefficients a1, 02,...,@, of the required linear function are to be chosen so 


as to minimize the quantity ri iL (bE — Sf, aia*)?, which is the mean-square 
deviation of the data obtained using the empirical formula from the results obtained 
in the experiments. 

Interpret this problem as the problem of best approximation of the vector 
(b!,..., b”) be linear combinations of the vectors (a}, .,@"),i=1,...,n and 
show that the question reduces to solving a system of linear equations of the same 
type as Eq. (18.18). 

2. a) Let C[a, b] be the vector space of functions that are continuous on the closed 
interval [a, b] with the metric of uniform convergence and C2[a, b] the same vector 
space but with the metric of mean-square deviation on that closed interval (that is, 


d(f,g)= ve | f — g|2(x) dx). Show that if functions converge in C[a, b], they 
also converge in C2[a, b], but not conversely, and that the space C2[a, b] is not 
complete, in contrast to C[a, b]. 

b) Explain why the system of functions {1,x,x?,...} is linearly independent 
and complete in C2[a, b], but is not a basis in that space. 

c) Explain why the Legendre polynomials are a complete orthogonal system and 
also a basis in C2[—1, 1]. 

d) Find the first four terms of the Fourier expansion of the function sinzx on 
the interval [—1, 1] in the system of Legendre polynomials. 

e) Show that the square of the norm ||P, || in C2[—1, 1] of the nth Legendre 
polynomial is 


2 - nM+1)(n+2)---2n C14 vn 
on +1 (=« 7 nian [¢ =) wr), 


1 


f) Prove that among all polynomials of given degree n with leading coefficient 1, 
the Legendre polynomial P,, (x) is the one closest to zero on the interval [—1, 1]. 
g) Explain why the equality 


(ee) 


1 
Y(n+ s)| f, reoeaenas 


n=0 


2 


’ 


1 
[ \sPeoer = 
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where {Po, P},...} is the system of Legendre polynomials, necessarily holds for 
every function f € C2({—1, 1], ©). 


3. a) Show that if the system {x 1, x2, ...} of vectors is complete in the space X and 
X is an everywhere-dense subset of Y, then {x1, x2,...} is also complete in Y. 

b) Prove that the vector space C[a, b] of functions that are continuous on the 
closed interval [a, b] is everywhere dense in the space 2[a, b]. (It was asserted in 
Problem 5g of Sect. 17.5 that this is true even for infinitely differentiable functions 
of compact support on [a, b].) 

c) Using the Weierstrass approximation theorem, prove that the trigonometric 
system {1, coskx, sinkx; k € N} is uae in R2[—7, 7]. 

d) Show that the systems {1, x, x? ..} and {1, coskx, sinkx; k € N} are both 
complete in R2[—7, x], but the first is “in a basis in this space and the second is. 

e) Explain why Parseval’s equality 


{ ¢* ae 
= | ifPoax= + Dia? + [be 
Tt 


holds, where the numbers a, and b; are defined by (18.9) he (18.10). 


f) Using the result of Example 8, now show that }°°° | = =*. 


4. Orthogonality with a weight function. 


a) Let po, P1,---, Pn be continuous functions that are positive in the domain D. 
Verify that the formula 


r=) / pe(x) f (xg (x) dx 
k=0"P 


defines an inner product in C” (D, C). 
b) Show that when functions that differ only on sets of measure zero are identi- 
fied, the inner product 


ee i; p(x) f(x) B(x) dx, 


involving a positive continuous function p can be introduced in the space R(D, C). 

The function p here is called a weight function, and if (f, g) = 0, we say that the 
functions f and g are orthogonal with weight p. 

c) Let g: D— G bea diffeomorphism of the domain D C R” onto the domain 
G CR’, and let {uz(y); k € N} be a system of functions in G that is orthogonal 
with respect to the standard inner product (18.2) or (18.3). Construct a system of 
functions that are orthogonal in D with weight p(x) = | dety’(x)| and also a system 
of functions that are orthogonal in D in the sense of the standard inner product. 

d) Show that the system of functions {@m.7(x, y) = ef (mxtny). im ny EN} is or- 
thogonal on the square J = {(x, y) € R? | |x| <a A |y| <z}. 
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e) Construct a system of functions orthogonal on the two-dimensional torus 
T? CR? defined by the parametric equations given in Example 4 of Sect. 12.1. 
The inner product of functions f and g on the torus is understood as the surface 


integral [70 fgdo. 


5. a) It is known from algebra (and we have also proved it in the course of dis- 
cussing constrained extremal problems) that every symmetric operator A : E” > 
E” on n-dimensional Euclidean space E” has nonzero eigenvectors. In the infinite- 
dimensional case this is generally not so. 

Show that the linear operator f(x) — xf (x) of multiplication by the indepen- 
dent variable is symmetric in C2([a, b], R), but has no nonzero eigenvectors. 

b) A Sturm!°-Liouville problem that often arises in the equations of math- 
ematical physics is to find a nonzero solution of an equation u(x) + [q(x) + 
Ap(x)]u(x) = 0 on the interval [a, b] satisfying certain boundary conditions, for 
example u(a) = u(b) = 0. 

Here it is assumed that the functions p(x) and g(x) are known and continuous 
on the interval [a, b] in question and that p(x) > 0 on [a, b]. 

We have encountered such a problem in Example 15, where it was necessary 
to solve Eq. (18.26) under the condition X (0) = X(/) = 0. In this case we had 
q(x) = 0, p(x) = 1, and [a, b] = [0,/]. We have verified that a Sturm—Liouville 
problem may in general turn out to be solvable only for certain special values of 
the parameter 4, which are therefore called the eigenvalues of the corresponding 
Sturm—Liouville problem. 

Show that if the functions f and g are solutions of a Sturm—Liouville problem 
corresponding to eigenvalues A ¢ # Ag, then the equality £(g' F=fO=07> 
Ag)pfg holds on [a,b] and the functions f and g are orthogonal on [a, b] with 
weight p. 

c) It is known (see Sect. 14.4) that the small oscillations of an inhomogeneous 
string fastened at the ends of the closed interval [a, b] are described by the equation 
(pu'.)). = puy,, where u = u(x, ft) is the function that gives the shape of the string 
at each time t, 0 = e(x) is the linear density, and p = p(x) is the elastic constant at 
the point x € [a, b]. The clamping conditions mean that u(a, t) = u(b, t) = 0. 

Show that if we seek the solution of this equation in the form X(x)T(t), the 
question reduces to a system T” = AT, (pX')’ = ApX, in which A is the same 
number in both equations. 

Thus a Sturm—Liouville problem arises for the function X (x) on the closed in- 
terval [a, b], which is solvable only for particular values of the parameter A (the 
eigenvalues). (Assuming that p(x) > 0 on [a, b] and that p € C[a, b] we can ob- 
viously bring the equation (pX’)’ = ApX into a form in which the first derivative is 
missing by the change of variable x = [ - % j .) 


a p 


'07.Ch.F. Sturm (1803-1855) — French mathematician (and, as it happens, an honorary foreign 
member of the Petersburg Academy of Sciences); his main work was in the solution of boundary- 
value problems for the equations of mathematical physics. 
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d) Verify that the operator S(u) = (p(x)u'(x))’ —q(x)u(x) on the space of func- 
tions in C®[a, b] that satisfy the condition u(a) = u(b) = 0 is symmetric on this 
space. (That is, (Su, v) = (u, Sv), where (,) is the standard inner product of real- 
valued functions.) Verify also that the eigenfunctions of the operator S' correspond- 
ing to different eigenvalues are orthogonal. 

e) Show that the solutions X; and X2 of the equation (pX’)’ = 4X correspond- 
ing to different values 4; and A2 of the parameter A and vanishing at the endpoints 
of the closed interval [a, b] are orthogonal on [a, b] with weight p(x). 


6. The Legendre polynomials as eigenfunctions. 


a) Using the expression of the Legendre polynomials P, (x) given in Example 5 
and the equality (x? — 1)” = (x — 1)"(« + 1)", show that P, (1) = 1. 

b) By differentiating the identity (x? — 1) 4 (x? — 1)" = 2nx(x? — 1)", show 
that P, (x) satisfies the equation 


(x? — 1) - P(x) + 2x - Ph(x) — n(n + 1) Pa(x) =0. 


c) Verify that the operator 


a d? d. a@f,5 d 
A:= (x We: + 2x =a ( 1) =| 
is symmetric in the space C™[—1, 1] C R2[—1, 1]. Then, starting from the relation 
A(P,) =n(n + 1) Py, explain why the Legendre polynomials are orthogonal. 

d) Using the completeness of the system {1, x, are jin C[-1, 1], show that 
the dimension of the eigenspace of the operator A corresponding to the eigenvalue 
n(n + 1) cannot be larger than 1. 

e) Prove that the operator A = 4. [(x? — 1) 4] cannot have eigenfunctions in the 
space C [1,1] except those in the system { Po(x), Pi (x), ...} of Legendre poly- 
nomials, nor any eigenvalues different from the number {n(n + 1);n =0, 1, 2,...}. 


7. Spherical functions. 


a) In solving various problems in R? (for example, problems of potential theory 
connected with Laplace’s equation Au = 0) the solutions are sought in the form of 
a series of solutions of a special form. Such solutions are taken to be homogeneous 
polynomials S,(x, y, z) of degree n satisfying the equation Au = 0. Such polyno- 
mials are called harmonic polynomials. In spherical coordinates (r, g, 8) a harmonic 
polynomial S,(x, y, z) obviously has the form r” Y,,(@, g). The functions Y,, (6, ~) 
that arise in this way, depending only on the coordinates 0 < 6 <a andO<@ <2 
on the sphere, are called spherical functions. (They are trigonometric polynomials 
in two variables with 2n + 1 free coefficients in Y,,, this number coming from the 
condition AS, = 0.) 

Using Green’s formula, show that for m ~n the functions Y,, and Y,, are or- 
thogonal on the unit sphere in IR? (in the sense of the inner product (Yj, Yn) = 
ff f Ym - Y, do, where the surface integral extends over the sphere r = 1). 
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b) Starting from the Legendre polynomials, one can also introduce the polyno- 
mials Pym = (0 — rd ere m=1,2,...,n, and consider the functions 


P,(cos@), Pnuim(cos@)cosmg, Py. m(sin@)sinm@. (*) 


It turns out that every spherical function Y,,(0, @) with index n is a linear com- 
bination of these functions. Accepting this result and taking account of the orthog- 
onality of the trigonometric system, show that the functions of the system (*) form 
an orthogonal basis in the (2n + 1)-dimensional space of spherical functions of a 
given index n. 


8. The Hermite polynomials. In the study of the equation of a linear oscillator in 
quantum mechanics it becomes neesaty to consider functions of class C®(R) 
with the inner product (f, g) ={"< fgdx in C®(R) C (R, C), and also the spe- 


cial functions H,(x) = (—1)"e*" es (e-* ),n=0,1,2,. 


a) Show that Ho(x) = 1, Hi (x) = 2x, Ho(x) = 4x? —2. 

b) Prove that H,(x) is a polynomial of degree n. The system of functions 
{Ho(x), Hi (x), ...} is called the system of Hermite polynomials. 

c) Verify that the function H,(x) satisfies the equation Hy’(x) — 2x H}(x) + 
2nH,(x) =0 

d) The functions w(x) = et H,(x) are called the Hermite functions. Show 
that yo" (x) + (2n + 1 — x7) Wp_ (x) =O, and that w(x) > 0.as x > oo. 

e) Verify that [T° Winn dx = 0 if m £n. 

f) Show that the Hermite polynomials are orthogonal on R with weight e~* 2m 


9. The Chebyshev—Laguerre!! polynomials {Ly,(x);n =0, 1,2,...} can be defined 
x d(x"e “). 
dx” 


by the formula Ly, (x) :=e 
Verify that 


a) Ly(x) is a polynomial of degree n; 
b) the function L;,(x) satisfies the equation 
KLE) +(- x)Li (x) +nLy(x) =0; 
c) the system {L,;n = 0, 1,2,...} of Chebyshev—Laguerre polynomials is or- 
thogonal with weight e~* on the half-line [0, +-oo[. 


10. The Chebyshev polynomials {Ty(x) = 1, Ty(x) = 2!~" cosn(arccos x); n € N} 
for |x| < 1 can be defined by the formula 


tea ia (1—2)"2, 


(2n)! dx” 


Show that: 


NEN. Laguerre (1834-1886) — French mathematician. 
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a) T,,(x) is a polynomial of degree n; 
b) 7,,(x) satisfies the equation 


(1 - a) 7, (x) — xT (x) + n Ty (x) = 0; 


c) the system {7,;n =0, 1, 2,...} of Chebyshev polynomials is orthogonal with 

‘ - 1 z = 
weight p(x) = Poors on the interval ]—1, 1[. 
11. a) In probability theory and theory of functions one encounters the follow- 
ing system of Rademacher! functions: {Wy(x) = 9(2"x);n = 0,1, 2,...}, where 
y(t) = sgn(sin 27). Verify that this is an orthonormal system on the closed interval 
[0, 1]. 

b) The system of Haar! functions {Xn,«(x)}, where n = 0,1,2,... and k= 

1,2,27,... is defined by the relations 


+e 2k—2 2k—-1 
iL, if gnt+l x< gn+l > 

= «¢ 2k—1 2k 
Xn,k(X) = —l, if ar oS Saat) 


0 at all other points of [0, 1]. 


Verify that Haar system is orthogonal on the closed interval [0, 1]. 


12. a) Show that every n-dimensional vector space with an inner product is isomet- 
rically isomorphic to the arithmetic Euclidean space R” of the same dimensions. 


b) We recall that a metric space is called separable if it contains a countable 
everywhere-dense subset. Prove that if a vector space with inner product is sepa- 
rable as a metric space with the metric induced by the inner product, then it has a 
countable orthonormal basis. 

c) Let X be a separable Hilbert space (that is, X is a separable and complete 
metric space with the metric induced by the inner product in X). Taking an or- 
thonormal basis {e;; i € N} in X, we construct the mapping X 5 x + (c1,¢2,...), 
where cj = (x, e;) are the Fourier coefficients of the expansion of the vector in the 
basis {e;}. Show that this mapping is a bijective, linear, and isometric mapping of X 
onto the space /2 considered in Example 14. 

d) Using Fig. 18.1, exhibit the basic idea of the construction of Example 14, 
and explain why it comes about precisely because the space in question is infinite- 
dimensional. 

e) Explain how to construct an analogous example in the space of functions 
Cla, b] C Rola, bl]. 


12H A. Rademacher (1892-1969) — German mathematician (American after 1936). 
'3.A. Haar (1885-1933) — Hungarian mathematician. 
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18.2.1 Basic Types of Convergence of Classical Fourier Series 


a. Trigonometric Series and Trigonometric Fourier Series 


A classical trigonometric series is a series of the form!* 


ao 


[oe] 
: +S  agcoskx + by sinks, (18.32) 


k=1 


obtained on the basis of the trigonometric system {1, coskx, sinkx; k € N}. The 
coefficients {ag, ax, bk; k € N} here are real or complex numbers. The partial sums 
of the trigonometric series (18.32) are the trigonometric polynomials 


ao 


n 
5 + oak coskx + by sinkx (18.33) 


k=1 


Ty (x) = 


corresponding to degree n. 

If the series (18.32) converges pointwise on R, its sum f(x) is obviously a func- 
tion of period 27 on R. It is completely determined by its restriction to any closed 
interval of length 27. 

Conversely, given a function of period 27 on R (oscillations, a signal, and the 
like) that we wish to expand into a sum of certain canonical periodic functions, the 
first claimants for such canonical status are the simplest functions of period 27, 
namely {1, coskx, sinkx; k € N}, which are simple harmonic oscillations of entire 
frequencies. 

Suppose we have succeeded in representing a continuous function as the sum 


(oe) 
Fx) = 2 + Vax coskx + by sin kx (18.34) 
2 k=1 


of a trigonometric series that converges uniformly to it. Then the coefficients of the 
expansion (18.34) can be easily and uniquely found. 
Multiplying Eq. (18.34) successively by each function of the system 


{1, cosks, sinkx; k € N}, 


using the fact that termwise integration is possible in the resulting uniformly con- 
vergent series, and taking account of the relations 


IU 
/ 1° dx =2n, 
—1 


'4Writing the constant term in the form ao/2, which is convenient for Fourier series, is not obliga- 
tory here. 
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a. 4 
/ cosmx cosnx dx = | sinmx sinnxdx =0 form#n,m,neéN, 
—1 =" 


us us 
J c08tnxax= [ sin’ nx dx = 7, neéN, 


—T = 


we find the coefficients 


1 is 
dk =a(f)=— f  f(x)ooskx dx, k=0,1,..., (18.35) 


=I0 


1 u 
be = ef) = — f(x)sinkxdx, k=1,2,... (18.36) 


—T 


of the expansion (18.34) of the function f in a trigonometric series. 

We have arrived at the same coefficients that we would have had if we had re- 
garded (18.34) as the expansion of the vector f € R2[—z, x] in the orthogonal 
system {1, coskx, sinkx; k € N}. This is not surprising, since the uniform conver- 
gence of the series (18.34) of course implies convergence in the mean on the closed 
interval [—7r, 7], and then the coefficients of (18.34) must be the Fourier coefficients 
of the function f in the given orthogonal system (see Sect. 18.1). 


Definition 1 If the integrals (18.35) and (18.36) have meaning for a function f, 
then the trigonometric series 


rae a) + ane + bk(f) sinkx (18.37) 


k=1 


assigned to f is called the trigonometric Fourier series of f. 


Since there will be no Fourier series in this section except trigonometric Fourier 
series, we shall occasionally allow ourselves to drop the word “trigonometric” and 
speak of just “the Fourier series of f”. 

In the main we shall be dealing with functions of class R([—z, 7], C), or, 
slightly more generally, with functions whose squared absolute values are integrable 
(possibly in the improper sense) on the open interval ]—z, z[. We retain our pre- 
vious notation 72[—z, 2] to denote the vector space of such functions with the 
standard inner product 


Tv 


(f,g= fgdx. (18.38) 


Bessel’s inequality 


laf)? 2 > 1 fF 
+ Dae + |be(f)| <7 sPear, (18.39) 
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which holds for every function f € R2([—z, 2], C), shows that by no means ev- 
ery trigonometric series (18.32) can be the Fourier series of some function f € 
Ro[-7, 7]. 


Example I The trigonometric series 
3 sinkx 
k=1 vk 


as we already know (see Example 7 of Sect. 16.2) converges on R, but is not the 
Fourier series of any function f € R2[—z, 7], since the series ale ae di- 
verges. 

Thus, arbitrary trigonometric series (18.32) will not be studied here, only Fourier 
series (18.37) of functions in R2[—z, 2], and functions that are absolutely inte- 
grable on ]—z, z[. 


b. Mean Convergence of a Trigonometric Fourier Series 


Let 


Soo! 


(f) n 
5 + Doar A eosks + bef) sinks, (18.40) 


be the nth partial sum of the Fourier series of the function f € R2[—z, 2]. The 
deviation of S, from f can be measured both in the natural metric of the space 
R2[—2, 1] induced by the inner product (18.38), that is, in the sense of the mean- 
square deviation 


7-5] f Lf — Spl2(x) dx (18.41) 


of S, from f on the interval [—z,, 7], and in the sense of pointwise convergence on 
that interval. 

The first of these two kinds of convergence was studied for an arbitrary se- 
ries in Sect. 18.1. Making the results obtained there specific in the context of a 
trigonometric Fourier series involves first of all noting that the trigonometric system 
{1, coskx, sinkx; k € N} is complete in R2[—7, zr]. (This has already been noted in 
Sect. 18.1 and will be proved independently in Sect. 18.2.4 of the present section.) 

Hence, the fundamental theorem of Sect. 18.1 enables us to say in the present 
case that the following theorem is true. 


Theorem 1 (Mean convergence of a trigonometric Fourier series) The Fourier se- 
ries (18.37) of any function f € R2([—, 1], C) converges to the function in the 
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mean (18.41), that is, 


fa) = aod) + So ag(f) coskx + by(f) sinkx, 
k=1 
and Parseval’s equality holds: 
1 
= | isPear= Laces + af) + [bef (18.42) 


We shall often use the more compact complex notation for trigonometric poly- 
nomials and trigonometric series, based on the Euler formulas e!* = cosx +isinx, 
cosx = 5(el* +e ?*), sinx = oH (e'* — e~'*), Using them, we can write the partial 
sum (18.40) of the Fourier series as 


n 
Sos) ce, (18.40’) 
k=—n 
and the series (18.37) itself as 
+00 ; 
f~ > ae, (18.37') 
—0o 
where 
(ag —ibe),  ifk >0, 
Ck = 4 440, ifk=0, (18.43) 
5(a_~ +ib_,), if k <0, 
that is, 


L. f* 
c=a(fy=— |] f@e dx, keZ, (18.44) 
20 Jan 
and hence the numbers cx are simply the Fourier coefficients of f in the system 
{elk*. k EZ}. 
We call attention to the fact that summation of the Fourier series (18.37’) is un- 


derstood in the sense of the convergence of the sums (18.407). 
In complex notation Theorem | means that for every function f € R2([—z, 7],C) 


fo) = awe 
and 


1 CO 
ag MIP = Doleac (18.45) 
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c. Pointwise Convergence of a Trigonometric Fourier Series 


Theorem | gives a complete solution to the problem of mean convergence of a 
Fourier series (18.37), that is, convergence in the norm of the space R2[—7z, 7]. 
The remainder of this section will be mainly devoted to studying the conditions for 
and the nature of pointwise convergence of a trigonometric series. We shall consider 
only the simplest aspects of this problem. The study of pointwise convergence of a 
trigonometric series, as a rule, is such a delicate matter that, despite the traditional 
central position occupied by Fourier series after the work of Euler, Fourier, and Rie- 
mann, there is still no intrinsic description of the class of functions that can be repre- 
sented by trigonometric series converging to them at every point (the Riemann prob- 
lem). Until recently it was not even known whether the Fourier series of a continuous 
function must converge to it almost everywhere (it was known that convergence need 
not occur at every point). Previously A.N. Kolmogorov’? had even given an exam- 
ple of a function f ¢ L[—z, 2] whose Fourier series diverged everywhere (where 
L[{—z, 1] is the space of Lebesgue-integrable functions on the interval [—z, zr], 
obtainable as the metric completion of the space R[—z, 7r]), and D.E. Men’shov!® 
constructed a trigonometric series (18.32) with coefficients not all zero that never- 
theless converged to zero almost everywhere (Men’ shov’s null-series). The problem 
posed by N.N. Luzin!’ (Luzin’s problem) of determining whether the Fourier series 
of every function f € L2[—z, 2] converges almost everywhere (where L2[—z, 1] 
is the metric completion of 72[—z, 7]) was answered in the affirmative only in 
1966 by L. Carleson.!* It follows in particular from Carleson’s result that the Fourier 
series of every function f € R2[—z, 2] (for example a continuous function) must 
converge at almost all points of the closed interval [—7, zr]. 


18.2.2 Investigation of Pointwise Convergence of a Trigonometric 
Fourier Series 


a. Integral Representation of the Partial Sum of a Fourier Series 


Let us now turn our attention to the partial sum (18.40) of the Fourier series (18.37) 
and, using the complex notation (18.40’) for the expression (18.44) for the Fourier 


5A.N. Kolmogorov (1903-1987) — outstanding Soviet scholar, who worked in probability the- 
ory, mathematical statistics, theory of functions, functional analysis, topology, logic, differential 
equations, and applied mathematics. 

6D.E. Men’shov (1892-1988) — Soviet mathematician, one of the greatest specialists in the theory 
of functions of a real variable. 


™N.N. Luzin (1883-1950) — Russian/Soviet mathematician, one of the greatest specialists in the 
theory of functions of a real variable, founder of the large Moscow mathematical school (“Lusita- 
nia’). 


8L. Carleson (b. 1928) — outstanding Swedish mathematician whose main works are in various 
areas of modern analysis. 
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coefficients, we make the following transformations: 


Sp(x) = v(z iL fie” ar elt = 


k=—-n 
1 

=5- fo “70(3 ee ya dt. (18.46) 
. k=—n 

But 
n . i(n+l)u _ ,—inu i(n+5)u _ ~i(nt4)u 
e e e e 
Dru) = Yo lM = a = —_——_——.__ (18.47) 
=. e 1 eit _ eo isu 


and, as can be seen from the very definition, D,(u) = (2n + 1) if e/“ = 1. 
Hence 


sin(n + 4)u 


1 


D,(u) = : 
sin zu 


(18.48) 
where the ratio is regarded as 2n + 1 when the denominator of the fraction becomes 


zero. 
Continuing the computation (18.46), we now have 


Sp(x) = x [ f@Dy(& — t)dt. (18.49) 


We have thus represented S,,(x) as the convolution of the function f with the 
function (18.48), which is called the Dirichlet kernel. 

As can be seen from the original definition (18.47) of the function D,(u), the 
Dirichlet kernel is of period 27 and even, and, in addition 


1 7 1 [* 
=| D,(u) du = -| D,(u) du = 1. (18.50) 
2m J_x X Jo 


Assuming the function f is of period 27 on R or is extended from [—z, z] to R 
so as to have period 27, and making a change of variable in (18.49), we obtain 


so + 5)t 


Sn(X) = 5— ~ [ fe-nb, (t) dt = =f. f(x - dt. (18.51) 


sin st 


In carrying out the change of variable here, we used the fact that the integral of a 
periodic function is the same over every interval whose length equals a period. 
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Taking account of the fact that D,(t) is an even function, we can rewrite 
Eq. (18.51) as 


1 us 
Sn (x) = a (f(«—1t)+ fe +1))Dn@ dt = 


i : 1 
aS (Foe) + f+) eet a, (18.52) 
2m Jo sin 5¢ 


The Riemann—Lebesgue Lemma and the Localization Principle 


The representation (18.52) for the partial sum of a trigonometric Fourier series, 
together with an observation of Riemann stated below, forms the basis for studying 
the pointwise convergence of a trigonometric Fourier series. 


Lemma 1 (Riemann—Lebesgue) /fa locally integrable function f :]w1, w2[ > R is 
absolutely integrable (perhaps in the improper sense) on an open interval |w1, w2[, 
then 


w2 . 
/ fe dx +0 asa>oo, AER. (18.53) 
(a) 


1 


Proof If |m1, w2[ is a finite interval and f(x) = 1, then Eq. (18.53) can be verified 
by direct integration and passage to the limit. 

We shall reduce the general case to this simplest one. 

Fixing an arbitrary ¢ > 0, we first choose an interval [a, b] C ]@, w2[ such that 
for every AER 


wo b 
ij fnye™ ax f f(xjel* dx] <e. (18.54) 


Oo) 


In view of the estimates 


= 


wo b 
Fesye™ de — J feaye™ ds 


| 


a ; wo ; a a2 
2 Lrove™|ax+ f° [fore |ar= [itinar [ | fle) dx 
Q| @| 


and the absolute integrability of f on ]@1,@2[, there does of course exist such a 
closed interval [a, b]. 

Since f € R([a, b], R) (more precisely f|[a,5) € R([a, b])), there exists a lower 
Darboux sum ae mj Ax;, where mj; = infrefxj_1,x/] J (x), such that 


b n 
o<| f(x)dx — So mjAxj <e. 
‘ j=l 


18.2 Trigonometric Fourier Series 527 


Now introducing the piecewise constant function g(x) = mj; for x € [xj-1, xj], 
j=1,...,n, we find that g(x) < f(x) on [a, b] and 


b , b : 
: f (xje** dx — / g(xyel** dx 


a 


O< 


= 


b ; b 
<[ LF) — gfe ax = f (f(x) —g(x))dx <e, (18.55) 


but 


= — ) (mje) | >0 asA>oo,rAeR. (18.56) 


Xj-1 


Comparing relations (18.53)—-(18.56), we find what was asserted. 


Remark 1 Separating the real and imaginary parts in (18.53), we find that 


w2 @2 
/ f(x)cosAxdx +0 and f(x) sinax dx > 0 (18.57) 
@ 


1 @) 


as A—> oo, A ER. If the function f in the preceding integrals had been complex, 
then, separating the real and imaginary parts in them, we would have found that 
relations (18.57), and consequently (18.53), would actually be valid for complex- 
valued functions f : ]@1, @2[ > C. 


Remark 2 If it is known that f € R»2[—z, 7], then by Bessel’s inequality (18.39) 
we can conclude immediately that 


8 8 
f(x)cosnxdx +0 and f(x) sinnx dx > 0 
JIC =—It 
as n + oo, n EN. Theoretically, we could have gotten by with just this discrete 
version of the Riemann—Lebesgue lemma for the elementary investigations of the 
classical Fourier series that will be carried out here. 


Returning now to the integral representation (18.52) of the partial sum of a 
Fourier series, we remark that if the function f satisfies the hypotheses of the 
Riemann—Lebesgue lemma, then, since sin xt > sin 56 > 0 for0<6<t<z,we 
can use (18.57) to write 


sin(n + 5)t 
1 


sin xt 


é 
0) = 5 | (f(x—1)+ f(x+n) dtto(1) asn— ov. (18.58) 
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The important conclusion one can deduce from (18.58) is that the convergence 
or divergence of a Fourier series at a point is completely determined by the behavior 
of the function in an arbitrarily small neighborhood of the point. 

We state this principle as the following proposition. 


Theorem 2 (Localization principle) Let f and g be real- or complex-valued locally 
integrable functions on |—1x,1[ and absolutely integrable on the whole interval 
(possibly in the improper sense). 

If the functions f and g are equal in any (arbitrarily small) neighborhood of the 
point xo € |—1, m[, then their Fourier series 


+00 +00 
far ane. 20)~ > awe 


either both converge or both diverge at xo. When they converge, their limits are 
equal.'° 


Remark 3 As can be seen from the reasoning used in deriving Eqs. (18.52) and 
(18.58), the point xq in the localization principle may also be an endpoint of the 
closed interval [—z, 2], but then (and this is essential!) in order for the periodic 
extensions of the functions f and g from the closed interval [—z, zr] to R to be equal 
on a neighborhood of xg it is necessary (and sufficient) that the original functions 
be equal on a neighborhood of both endpoints of the closed interval [—z, zr]. 


c. Sufficient Conditions for a Fourier Series to Converge at a Point 


Definition 2 A function f : U > C defined on a deleted neighborhood of a point 
x €R satisfies the Dini conditions at x if 


a) both one-sided limits 
f(x_)= lim fx—f), f(y) = lim feta 
t>+0 t>+0 


exist at x; 
b) the integral 


FE -D-FON+ FA+) — f+) 4 


+0 t 


converges absolutely.?° 


19 Although the limit need not be f (xo) = g(xo). 


20What is meant is that the integral Io converges absolutely for some value ¢ > 0. 
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Example 2 If f is a continuous function in U(x) satisfying the Hélder condition 
|f@+o—f@]|<Mit|*, O<aK<1, 
then, since the estimate 


M 
s 
|t|1- 


Perens 
t 


now holds, the function f satisfies the Dini conditions at x. 

It is also clear that if a continuous function f defined in a deleted neighborhood 
U (x) of x has one-sided limits f(x_) and f(x) and satisfies one-sided Hélder 
conditions 


[fe t+2)— f(x4)| < Mt, 
| f(x —1) — f(x_)| < Mt, 


where t > 0, 0 <a@ < 1, and M is a positive constant, then f will satisfy the Dini 
conditions for the same reason as above. 


Definition 3 We shall call a real- or complex-valued function f piecewise- 
continuous on the closed interval [a, b] if there is a finite set of points a = x9 < 
X1 <-+--++<X, =b in this interval such that f is defined on each interval |x ;-1, x;[, 
j =1,...,n, and has one-sided limits on approach to its endpoints. 


Definition 4 A function having a piecewise-continuous derivative on a closed in- 
terval is piecewise continuously differentiable on that interval. 


Example 3 If a function is piecewise continuously differentiable on a closed inter- 
val, then it satisfies the Hélder conditions with exponent a = | at every point of the 
interval, as follows from Lagrange’s finite-increment (mean-value) theorem. Hence, 
by Example |, such a function satisfies Dini’s conditions at every point of the in- 
terval. At the endpoints of the interval, of course only the corresponding one-sided 
pair of Dini’s conditions needs to be verified. 


Example 4 The function f(x) = sgnx satisfies Dini’s conditions at every point 
x €R, even at zero. 


Theorem 3 (Sufficient conditions for convergence of a Fourier series at a point) 
Let f :R > C be a function of period 21 that is absolutely integrable on the closed 
interval |—1, 1]. If f satisfies the Dini conditions at a point x € R, then its Fourier 
series converges at that point, and 


+00 
age? = Pena (18.59) 
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Proof By relations (18.52) and (18.50) 


S,(x) f(x) : F4) 


: a (f(x —t) — f@_)) + FO +9 — fy) sin(n+ 5) 
T JO 2 , 


1 
2 sin xt 


Since 2 sin st ~ tas t —> +0, by the Dini conditions and the Riemann—Lebesgue 
lemma we see that this last integral tends to zero as n > oo. 


Remark 4 In connection with the theorem just proved and the localization principle, 
we note that changing the value of the function at a point has no influence on the 
Fourier coefficients or the Fourier series or the partial sums of the Fourier series. 
Therefore the convergence and the sum of such a series at a point is determined not 
by the particular value of the function at the point, but by the integral mean of its 
values in an arbitrarily small neighborhood of the point. It is this fact that is reflected 
in Theorem 3. 


Example 5 In Example 6 of Sect. 18.1 we found the Fourier series 
x~ >) 2~—__sinkx (18.60) 


for the function f(x) = x on the closed interval [—z, 2]. Extending the function 
f (x) periodically from the interval ]—z, z[ to the whole real line, we may assume 
that the series (18.60) is the Fourier series of this extended function. Then, on the 
basis of Theorem 3 we find that 


[ee 


—| k+1 : 
ae tee ee 
= k 0, if |x|=z. 


In particular, for x = 5 it follows from this relation that 
[o,@) 


s (-1)” _a 
+1 4° 


n=0 


Example 6 Let a € R and |a| < 1. Consider the 27r-periodic function f(x) defined 
on the closed interval [—z, 2] by the formula f(x) = cosax. 
By formulas (18.35) and (18.36) we find its Fourier coefficients 
1 [7 (—1)" sina 2a 
an(f) = — cosax cosnx dx = : 
NU Jon TU a 


1 Tw 
bna(f) = -f cosax sinnx dx = 0. 


—T 


18.2 Trigonometric Fourier Series 531 


By Theorem 3 the following equality holds at each point x € [—z, zr]: 


2a pe bt Stel 
cosax = + 5) cosnx }. 
—n 


1 202 a 
n=1 


When x = 77, this relation implies 


Yee. A 
t = 18.61 
edad = a aye ( ) 


Ta 


n=1 


! 5, and hence the series on the right-hand 


If || <a <1, then |>45| < =, Z 


side of Eq. (18.61) converges uniformly with respect to a on every closed interval 
|a| < ao < 1. Hence it is legitimate to integrate it termwise, that is, 


ik (corre Saray fT aie 


and 
1 nee ‘= Doble -+4/| 
yielding 
\ sin wx v1 1 x 
= nj l——)}, 
Xx n2 
n=1 
and finally, 


: oo 2 
SIN TX Xx 
= H(: & =) when |x| < 1. (18.62) 
TTX - n 


We have thus proved relation (18.62), which we mentioned earlier when deriving 
the complement formula for Euler’s function I(x) (Sect. 17.3). 


d. Fejér’s Theorem 


Let us now consider the sequence of functions 


So(x) +++: + Sn) 
On (x) = ee ; 


that are the arithmetic means of the corresponding partial sums So(x),..., Sn(x) of 
the trigonometric Fourier series (18.37) of a function f : R > C of period 27. 
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From the integral representation (18.51) of the partial sum of the Fourier series 
we have 


oly= sf fle Funar, 
20 Jz 
where 
1 
F,io= apy (Pow) +--+ + Dy(t)). 


Recalling the explicit form (18.48) of the Dirichlet kernel and taking account of 
the relation 


= oe a 2 n+l 

1 1 1 sin t 

) sin{ k+ = }t = =( sin =t ) (cos kt — cos(k + 1)t) = ena : 
2 2 2 sin 4t 

k=0 k=0 2 

we find 


F(t) sin” nti 
t) = —————_... 
. (n + 1) sin? 47 


The function F,, is called the Fejér kernel, more precisely the nth Fejér kernel.*! 

Taking account of the original definition (18.47) of the Dirichlet kernel D,,, one 
can conclude that the Fejér kernel is a smooth function of period 277 whose value 
equals (n + 1) where the denominator of this last fraction equals zero. 

The properties of the Fejér and Dirichlet kernels are similar in many ways, but in 
contrast to the Dirichlet kernel, the Fejér kernel is also nonnegative, so that we have 
the following lemma. 


Lemma 2 The sequence of functions 


se Fn(x), if lxl <x, 


ani=|2 if |x| > 


is an approximate identity on R. 


Proof The nonnnegativity of A, (x) is clear. 
Equality (18.50) enables us to conclude that 


i Ayn (x) dx = ff An (x) dx = =f. Fn(x) dx = 
—oo —1 2m Jn 


1 “7 
= sae af, DH er= 


211, Fejér (1880-1956) — well-known Hungarian mathematician. 
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Finally, for every 6 > 0 


=5 +00 1m 
of A vows f An ome An (x) dx < 
= r) 


= Onin ae sin? 5x 


asn — +00. 


Theorem 4 (Fejér) Let f : R-> = ie a function of period 2x that is absolutely 
integrable on the closed interval [— ]. If 


a) fis uniformly continuous on the set E CR, then 
on(x) 3 f(x) onEasn>ow; 
b) f €C(R, C), then 
On(x) 3 f(x) onRasn> oo; 
c) fis continuous at the point x € R, then 
On(x) > f(x) asn->o. 


Proof Statements b) and c) are special cases of a). 
Statement a) itself is a special case of the general Proposition 5 of Sect. 17.4 on 
the convergence of a convolution, since 


1 as 
ia= sf Se -DFn Ode = (7 # Ani). 


Corollary 1 (Weierstrass’ theorem on approximation by trigonometric polynomi- 
als) If a function f :[—m,1] — C is continuous on the closed interval [—1, 1] 
and f (—1) = f (x), then this function can be approximated uniformly on the closed 
interval [—1, 1] with arbitrary precision by trigonometric polynomials. 


Proof Extending f as a function of period 277, we obtain a continuous 27 -periodic 
function on R, to which the trigonometric polynomials o,(x) converge uniformly 
by Fejér’s theorem. 


Corollary 2 [f f is continuous at x, its Fourier series either diverges at x or con- 
verges to f(x). 


Proof Only the case of convergence requires formal verification. If the sequence 
Sn (x) has a limit asm — oo, then the sequence oy (x) = SoG Su) has that same 
limit. But by Fejér’s theorem o, (x) > f(x) as n + ov, and hence S,(x) > f(x) 


also whenever the limit S,,(x) exists as n > co. 
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Remark 5 We note that the Fourier series of a continuous function really can diverge 
at some points. 


18.2.3, Smoothness of a Function and the Rate of Decrease 
of the Fourier Coefficients 


a. An Estimate of the Fourier Coefficients of a Smooth Function 
We begin with a simple, yet important and useful lemma. 


Lemma 3 (Differentiation of a Fourier series) [f a continuous function f € 
C([-z, 2], C) assuming equal values at the endpoints of the closed interval 
[—z, 2] is piecewise continuously differentiable on [—1, 1], then the Fourier se- 
ries of its derivative 


[oe 


cal ss » ck( f’)el* 


can be obtained by differentiating formally the Fourier series 


[o,@) 
f ey sagie™ 
—0o 
of the function itself, that is, 
ce(f’) =ikex(f), keZ. (18.63) 


Proof Starting from the definition of the Fourier coefficients (18.44), we find 
through integration by parts that 


Le 1 sesite. tf =“ 
ex(f’) = =f. fixe ™ dx = sf me|T, - = iz fae" dx = 


=ikck(f), 


since f (m)e** — f(—m)e!** =0. 


Proposition 1 (Connection between smoothness of a function and the rate of de- 
crease of its Fourier coefficients) Let f ¢ C~)({—2,2],C) and f)(—r) = 
fP(a), 7 =0,1,...,m — 1. If the function f has a piecewise-continuous deriva- 
tive fe of order m on the closed interval [—1, 1], then 


cx(f™) = Gk" ce(f), ke, (18.64) 
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and 


Vk 
|k|™ 


1 
lee(f)| = =o( zr) ask —> oo, keEZ; (18.65) 


moreover, ) ~~, ye <0. 
Proof Relation (18.64) follows from an m-fold application of Eq. (18.63): 
caf) = bce (FO?) = = Ge S). 


Setting y, = |cx( | and using Bessel’s inequality 


Salsa f 


f 


| FP) dx, 
vs 


we obtain (18.65) from (18.64). 


Remark 6 In the proposition just proved, as in Lemma 3, instead of assuming the 
conditions f DM(—-n) = f (gr), we could have assumed that f is a function of 
period 27 on the entire line. 


Remark 7 If a trigonometric Fourier series were written in the form (18.37), rather 
than in the complex form (18.37’), it would be necessary to replace the simple rela- 
tions (18.64) by noticeably more cumbersome equalities, whose meaning, however, 
would be the same: under these hypotheses a Fourier series can be differentiated 
termwise whichever from it is written in, (18.37) or (18.37’). As for the estimates of 
the Fourier coefficients, a,(f) and by (f) of (18.37), since ag (f) = ce(f) +ce_-k(f) 
and by( f) =i(cx(f) — c_x(f)), (see formulas (18.43)) it follows from (18.65) that 
if a function f satisfies the hypotheses of the proposition, then 


Ok Bx 
Ja D| = or [be P)| =o keEN, (18.64’) 
where )\¢2, a@7 < co and °°, B? < oo, and we can assume that a; = By = yk + 
Yk: 


b. Smoothness of a Function and the Rate of Convergence of Its Fourier Series 


Theorem 5 /f the function f :[—m,2] — C is such that 


a) fec™-Y[_-z,1],meN, 

b) f)(—2) = f(z), j =0,1,...,m—1, 

c) f has a piecewise continuous mth derivative f on [—n, 1], m > 1, then 
the Fourier series of f converges absolutely and uniformly on [—x, 7] to f, and 
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the deviation of the nth partial sum S,(x) of the Fourier series from f(x) has the 
following estimate on the entire interval: 


If@)—5,@|< "5. 


where {&,} is a sequence of positive numbers tending to zero. 


Proof We write the partial sum (18.40) of the Fourier series in the compact notation 
(18.40’): 


Sax) = dla(pe™. 


—n 


According to the assumptions on the function f and Proposition 1 we have 
len (f)| = ve/|KI", and S° yx/|k|!" < co: since 0 < yg /|k|" < s(v2 +1/k?”") and 
m > 1, we have > y/|k|” < oo. Hence the sequence S,(x) converges uniformly 
on [—z, 7] (by the Weierstrass M-test for series and the Cauchy criterion for se- 
quences). 

By Theorem 3 the limit S(x) of S,(x) equals f(x), since the function f satisfies 
the Dini conditions at each point of the closed interval [—z, 7] (see Example 3). 
And, since f(—) = f(z), the function f can be extended to R as a periodic func- 
tion with the Dini conditions holding at each point x € R. 

Now, using relation (18.63), we can proceed to obtain an estimate: 


|) — Sn(x)| = |S) -—Sa@)=| Do cafe] < 
+k=n+1 
< DF le(Al= do w/la"< 
tk=n+1 tk=n+1 
oo 1/2 oo 1/2 
(ENE) 
tk=n+1 tk=n+1 


The first factor on the right-hand side of the Cauchy—Bunyakovskii inequality 
here tends to zero as n — oo, since am Ve <O. 
Next (see Fig. 18.2) 


(ee) 


: 0° 
m — 
» I/k <| x2" Im — 1 n2m-l* 


k=n+1 


We thus obtain the assertion of Theorem 5. 


In connection with these results we now make a number of useful remarks. 
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Fig. 18.2 


Fig. 18.3 


Remark 8 One can now easily obtain again the Weierstrass approximation theorem 
stated in Corollary | from Theorem 5 (and Theorem 3, of which essential use was 
made in the proof of Theorem 5), independently of Fejér’s theorem. 


Proof It suffices to prove this result for real-valued functions. Using the uniform 
continuity of f on [—z, 2], we approximate f on this closed interval uniformly 
within ¢/2 by a piecewise-linear continuous function g(x) assuming the same val- 
ues as f at the endpoints, that is, g(—7) = g(7) = f (7) (Fig. 18.3). By Theorem 5 
the Fourier series of g converges to g uniformly on the closed interval [—7z, zr]. 
Taking a partial sum of this series that differs from g(x) by less than ¢/2, we obtain 
a trigonometric polynomial that approximates the original function f within ¢ on 
the whole interval [—z, z]. 


Remark 9 Let us assume that we have succeeded in representing a function f hav- 
ing a jump singularity as the sum f = @-+ yw of a certain smooth function yw and 
a simple function g having the same singularity as f (Fig. 18.4a, c, b). Then the 
Fourier series of f is the sum of the Fourier series of 7, which converges rapidly 
and uniformly by Theorem 5, and the Fourier series of the function g. The latter 
can be regarded as known, if we take the standard function g (shown in the figure 
as g(x) = —z — x for —m < x <Oand g(x) =z — x for0<x <7z). 

This observation can be used both in theoretical and computational problems 
connected with series (it is Krylov’s”* method of separating singularities and im- 


22 ALN. Krylov (1863-1945) — Russian/Soviet specialist in mechanics and mathematics, who made 
a large contribution to computational mathematics, especially in methods of computing the ele- 
ments of ships. 
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Fig. 18.4 


proving the convergence of series) and in the theory of trigonometric Fourier series 
itself (see for example the Gibbs”> phenomenon, described below in Problem 11). 


Remark 10 (Integration of a Fourier series) By Theorem 5 we can state and prove 
the following complement to Lemma 3 on differentiation of a Fourier series. 


Proposition 2 [f the function f :[—1,2]— C is piecewise continuous, then after 
integration the correspondence f (x) ~ ¥~°, crf )e!** becomes the equality 


‘ RAY ike 
[ Fd = eo Nx + D <(e — 1), 


where the prime indicates that the term with index k = 0 is omitted from the sum; the 
summation is the limit of the symmetric partial sums }*" ,,, and the series converges 
uniformly on the closed interval [—1, 1]. 


Proof Consider the auxiliary function 


x 
Fa)= fo foar—aoths 
0 
on the interval [—z, rz]. Obviously F € C[—z, 1]. Also F(—z) = F(z), since 


rs 
F(x) — F(-1) = f(t) dt — 2mco(f) = 9, 

—t 
as follows from the definition of co(f). Since the derivative F’(x) = f(x) — co(f) 
of the function F is piecewise continuous, its Fourier series om cy (Fe! Kx con- 
verges uniformly to F on the interval [—z, x] by Theorem 5. By Lemma 3 we have 
cy(F) = oF) for k £0. But cy (F’) = cg(F) if k 4 0. Now writing the equality 
F(x) = Ro ch(F Jel in terms of the function f and noting that F(O) = 0, we 
obtain the assertion of the proposition. 


23J.W. Gibbs (1839-1903) — American physicist and mathematician, one of the founders of ther- 
modynamics and statistical mechanics. 
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18.2.4 Completeness of the Trigonometric System 


a. The Completeness Theorem 


In conclusion we return once again from pointwise convergence of the Fourier series 
to its mean convergence (18.41). More precisely, using the facts we have accumu- 
lated on the nature of pointwise convergence of the Fourier series, we now give a 
proof of the completeness of the trigonometric system {1, coskx, sinkx; k € N} in 
R2({—z, 1], R) independent of the proof already given in the problems. In doing 
so, as in Sect. 18.2.1, we take R2([—z, 2], R) or R2([—z, 2], C) to mean the vec- 
tor space of real- or complex-valued functions that are locally integrable on |—z, z[ 
and whose squared absolute values are integrable on ]—z, z[ (possibly in the im- 
proper sense). This vector space is assumed to be endowed with the standard inner 
product (18.38) generating the norm in terms of which convergence is mean conver- 
gence (18.41). 

The theorem we are about to prove asserts simply that the system of trigonomet- 
ric functions is complete in 72([—z, 7], C). But we shall state the theorem in such 
a way that the statement itself will contain the key to the proof. It is based on the 
obvious fact that the property of completeness is transitive: if A approximates B 
and B approximates C, then A approximates C. 


Theorem 6 (Completeness of the trigonometric system) Every function f € 
R2[—2, 1] can be approximated arbitrarily closely in mean 


a) by functions of compact support in |—1, m[ that are Riemann integrable over 
the closed interval [—1, 1]; 

b) by piecewise-constant functions of compact support on the closed interval 
[—z, 1]; 

c) by piecewise-linear continuous functions of compact support on the closed 
interval [—1, 1]; 

d) by trigonometric polynomials. 


Proof Since it obviously suffices to prove the theorem for real-valued functions, we 
confine ourselves to this case. 
a) It follows from the definition of the improper integral that 
Xu ro 
f?(x)dx = lim / f(x) dx. 
—1 b> +0 Jz +65 
Hence, for every ¢ > 0 there exists 5 > 0 such that the function 


f(x), if|x|<a—64, 


0 ifm#—d< |x| <a, 


f0o=| 
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will differ in mean from f on [—z, zr] by less than e, since 


—1+6 


G7 ORS i 


ST: 


Poyart fo f° (x) dx. 
m—6d 


b) It suffices to verify that every function of the form fs; can be approximated 
in R»2([—7, 7], R) by piecewise-constant functions of compact support in [—z, 7]. 
But the function fs is Riemann-integrable on [—z + 45, 2 — 6]. Hence it is bounded 
there by a constant M and moreover there exists a partition —7 + 6 = x9 < x1 < 
+++ <X, = — 6 of this closed interval such that the corresponding lower Darboux 
sum )~/_, mj; Ax; of the function fs differs from the integral of fs over [—x + 
5,7 — 6] by less than ¢ > 0. 

Now setting 


mj, ix €)x;-1,xj,,i=1,...,n, 
g(x) = 
0, at all other points of [—z, 7], 


we obtain 


(fs — g)2(x) dx =| K=siptei@des 


Ke 
m—5d 
<2M (fs — g)(x) dx <2Me, 
—1m+6 
and hence fs really can be approximated arbitrarily closely in the mean on [—z, ] 
by piecewise-constant functions on the interval that vanish in a neighborhood of the 
endpoints of the interval. 
c) It now suffices to learn how to approximate the functions in b) in mean. Let 
g be such a function. All of its points of discontinuity x;,...,x, lie in the open 
interval ]—z, z[. There are only finitely many of them, so that for every ¢ > 0 one 
can choose 6 > 0 so small that the 6-neighborhoods of the points x1,..., x, are 
disjoint and contained strictly inside the interval ]—zr, x[, and 26nM < e, where 
M= SUP | x|<7 |g(x)|. Now replacing the function g on [x; —6,x; + 6],i=1,...,n, 
by the linear interpolation between the values g(x; — 5) and g(x; +6) that g assumes 
at the endpoints of this interval, we obtain a piecewise linear continuous function 
gs that is of compact support in [—z, z]. By construction |g3(x)| < M on [—z, rr], 
so that 


4 


/ (g — g3)*(x) dx < 2M lg — gs|(x) dx = 


= 


ne pxits 
=2M)° lg — gs|(x) dx <2M -(2M-25)-n < 
j=] ° 1-8 


<4Me, 


and the possibility of the approximation is now proved. 
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d) It remains only to show that one can approximate any function of class c) 
in mean on [—z, z] by a trigonometric polynomial. But for every ¢ > 0 and ev- 
ery function of type gs, Theorem 5 enables us to find a trigonometric polynomial 
T, that approximates gs uniformly within e on the closed interval [—z, 2]. Hence 
eg (g3 — Tn)* dx < 2m”, and the possibility of an arbitrarily precise approxima- 
tion in mean by trigonometric polynomials on [—7, 7] for any function of class c) 
is now established. 

By the triangle inequality in R2[—7, 2] we now conclude that all of Theorem 6 
on the completeness of these classes in 2[—z, z] is also proved. 


b. The Inner Product and Parseval’s Equality 


Now that the completeness of the trigonometric system in R2([—7, 2], C) has been 
proved, we can use Theorem | to assert that 


aod) 4 S > ak(f) cos kx + bk (f) sinkx (18.66) 


k=1 


f= 
for every function f € R2([—Z, 1], C), or, in complex notation, 


f= diek(fe™ (18.67) 


—oo 


where the convergence is understood as convergence in the norm of #2[—1,, zr], that 
is, as mean convergence, and the limiting passage in (18.67) is the limit of sums of 
the form S, (x) = °”,, ce(fye!* as n > oo. 

If we rewrite Eqs. (18.66) and (18.67) as 


1 ag(f) 1 sinkx 
= + aaa , 18.66’ 
oF are ye aN (Ne 18.66") 


1 oo eikx 
js = el f=, (18.67’) 
20 f x : V2 
then the right-hand sides contain series in the orthonormal systems 


1 1 

coskx, —= sinkx; ken 
ey Vit ia 

and {sel k € Z}. Hence by the general rule for computing the inner product 


of vectors from their coordinates in an orthonormal basis, we can assert that the 
equality 


1 a = _ 
ig I) a: S- ax (fa (g) + def IBeCg) (18.68) 
A 2 


k=1 
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holds for functions f and g in R2({—7, 1], C), or, in other notation, 


ee) 


(fig) = do ce( Pex (g), (18.69) 


—oo 


1 
20 
where, as always, 
Fi 
(f.g)= f (x)g(x) dx. 
—7 


In particular, if f = g, we obtain the classical Parseval equality from (18.68) and 
(18.69) in two equivalent forms: 


1 2 a 
Ay ft? = OE acl? + ec? (18.70) 
k=] 
1 CO 
5 IFIP = dlecAl’: (18.71) 


We have already noted that from the geometric point of view Parseval’s equality 
can be regarded as an infinite-dimensional version of the Pythagorean theorem. 
Parseval’s relation provides the basis for the following useful proposition. 


Proposition 3 (Uniqueness of Fourier series) Let f and g be two functions in 
R2[—, 1]. Then 


a) if the trigonometric series 


(oe) Cc 
S + Yo ax coskx + by sinkx (- 2 ac) 


k=1 


converges in mean to f on the interval |—1, 1] it is the Fourier series of f ; 
b) if the functions f and g have the same Fourier series, they are equal almost 
everywhere on [1, 1], that is, f = g in R2[—-7, 7]. 


Proof Assertion a) is actually a special case of the general fact that the expansion 
of a vector in an orthogonal system is unique. The inner product, as we know (see 
Lemma |b) shows immediately that the coefficients of such an expansion are the 
Fourier coefficients and no others. 

Assertion b) can be obtained from Parseval’s equality taking account of the com- 
pleteness of the trigonometric system in ?2([—7, 2], C), which was just proved. 

Since the difference (ff — g) has a zero Fourier series, it follows from Parseval’s 
equality that || f — gllz, = 0. Hence the functions f and g are equal at all points of 
continuity, that is, almost everywhere. 
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Remark 11 When studying Taylor series )~~ 9 £ = (x — a)" we noted previously 
that different functions of class C‘°)(R, IR) can have the same Taylor series (at 
some points a € R). This contrast with the uniqueness theorem just proved for the 
Fourier series should not be taken too seriously, since every uniqueness theorem is 
a relative one in the sense that it involves a particular space and a particular type of 
convergence. 

For example, in the space of analytic functions (that is, functions that can be 
represented as power series )--° 9 an(z — zo)" converging to them pointwise), two 
different functions have distinct Taylor series about every point. 

If, in turn, in studying trigonometric series we abandon the space R2[—z, 7] 
and study pointwise convergence of a trigonometric series, then, as already noted 
(p. 524) one can construct a trigonometric series not all of whose coefficients are 
zero, which nevertheless converges to zero almost everywhere. According to Propo- 
sition 3 such a null-series of course does not converge to zero in the mean-square 
sense. 

In conclusion, we illustrate the use of the properties of trigonometric Fourier se- 
ries obtained here by studying the following derivation, due to Hurwitz,~* of the 
classical isoperimetric inequality in the two-dimensional case. In order to avoid 
cumbersome expressions and accidental technical difficulties, we shall use complex 
notation. 


Example 7 Between the volume V of a domain in the Euclidean space E”, n > 2, 
and the (m — 1)-dimensional surface area F of the hypersurface that bounds it, the 
following relation holds: 


nv,V" | =F", (18.72) 


called the isoperimetric inequality. Here v, is the volume of the n-dimensional unit 
ball in E”. Equality in the isoperimetric inequality (18.72) holds only for the ball. 

The name “isoperimetric” comes from the classical problem of finding the closed 
plane curve of a given length L that encloses the largest area S. In this case inequal- 
ity (18.72) means that 


An $< L?, (18.73) 


It is this inequality that we shall now prove, assuming that the curve in question 
is smooth and is defined parametrically as x = g(s), y= W(s), where s is arc length 
along the curve and g and y belong to C“[0, L]. The condition that the curve be 
closed means that (0) = g(L) and w(0) = w(ZL). 

We now pass from the parameter s to the parameter t = 27 + — 7, which ranges 
from —zr to z, and we shall assume that our curve is defined parametrically as 


x=x(t), ysyQ, -<t<z, (18.74) 


4.4. Hurwitz (1859-1919) — German mathematician, a student of F. Klein. 
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with 
x(—1) =x(z), y(—1) = y(a). (18.75) 
We write (18.74) as a single complex-valued function 
z=2(t), —-mw<tK<7z, (18.74) 


where z(t) = x(t) +iy(t) and by (18.75) z(—) = z(z). 
We remark that 


2 
2 2 2 ds 
IOP = («OY +00) -() 
and hence under our choice of parameter 
2 
! 2 L 
t)| = —. 18.76 
oP == (18.76) 


Next, taking into account the relations Zz’ = (x — iy)(x' + iy’) = (xx' + yy’) + 
i(xy’ — x’y), and using Eqs. (18.75), we write the formula for the area of the region 
bounded by the closed curve (18.74): 


S= sf (xy’ — yx’)(t) dt = =f z/(t)z(t) de. (18.77) 


We now write the Fourier series expansion of the function (18.74’): 


CO 
z(t) = > cxel™. 
—o0o 


Then 


CO 
Z(th~ > ikcpel*. 


—cC 


Equalities (18.76) and (18.77) mean in particular that 


1 ry 1 wt ; 2 =. 
lkeP== f[ kora= 5. 


and 
ie ny creeee i 
—(z’,zh=— | c)z@)dt=—S. 
20 Jag IT 


In terms of Fourier coefficients, as follows from Eqs. (18.69) and (18.71), these 
relations assume the form 


CO 
L? =4n? Skee’, 
—0o 
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CO 
S=a So kenee. 
—o0o 
Thus, 
— 4S = 47? yw k)\ckl’. 


The right-hand side of this equality is obviously nonnegative and vanishes only 
if cg =0 for all k € Z except k = 0 andk = 1. 

Thus, inequality (18.73) is proved, and at the same time we have found the equa- 
tion 


z(t) =co+ ciel’, —m<t<q7, 


of the curve for which it becomes equality. This is the complex form of the para- 
metric equation of a circle with center at co in the complex plane and radius |cj|. 


18.2.5 Problems and Exercises 


1. a) Show that 


CO ‘ 
sinnx mw—-x 
y = for 0 <x < 27, 


and find the sum of the series at all other points of R. 
Using the preceding expansion and the rules for operating with trigonometric 
Fourier series, now show that the following equalities are true. 


b) Dye , Ms = 4 4 forO<x <z. 


ey ye an sf = 4 forO<x<n. 


d) ye, 
e) x7= q es ie cosnx for |x| <7. 


_ a 4 co =6cos(2k—1)x 
ea 5 = 22 Oats forO<x <7. 
oy) 2 gia 
g) oe ye wr tor <x <0. 
h) Sketch the graph of the sums of the trigonometric series here over the entire 
real line R. Using the results obtained, find the sums of the following numerical 


series: 


~sinnx = % for |x| <7. 


2. Show that: 


a) if f :[—2,2] — C is an odd (resp. even) function, then its Fourier coeffi- 
cients have i: following property: ax(f) =0 (resp. by (f) = 0) fork = 0, 1,2,...; 
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b) if f : R— C has period 27/m then its Fourier coefficients c,(f) can be 
nonzero only when k is a multiple of m; 

c) if f :[—2, 2] > R is real-valued, then cx(f) = c_x(f) for all k € N; 

d) la(fl < 2supyjer(F@OL ICAL < 2supyjerIf@! lef < 
SUP |x| <7 | f(x)I. 


3. a) Show that each of the systems {coskx;k = 0,1,...} and {sinkx; k € N} is 
complete in the space R2[a, a+] for any value of ae R. 

b) Expand the function f(x) = x in the interval [0, 2] with respect to each of 
these two systems. 

c) Draw the graphs of the sums of the series just found over the entire real line. 

d) Exhibit the trigonometric Fourier series of the function f(x) = |x| on the 
closed interval [—z, x] and determine whether it converges uniformly to this func- 
tion on the entire closed interval [—z, zr]. 


4. The Fourier series °° ce(f ye’ of a function f can be regarded as a spe- 


cial case of a power series )°° cxz* (= pa cheek + 9° cez*), in which z is 


restricted to the unit circle in the complex plane, that is, z= e’’. 

Show that if the Fourier coefficients c,(f) of the function f :[—z,a7] > C 
vanish so rapidly that lim, ,_,, ler(f)|1/* = c_ > 1 and Timp +00 |ex(f)|!/* = 
c+ <1, then 


a) the function f can be regarded as the image of the unit circle under a function 
represented in the annulus C= [z| < oo by the series )°°, ce 

b) for z =x + iy and In + <y<lIn + the series }°*. cx( fe" converges 
absolutely (and, in particular, its sum is independent of the order of summation of 
the terms); 

c) in any strip of the complex plane defined by the conditions a < Imz < b, 
where In + <a<b<ln oe the series °° ce(f )e'* converges absolutely and 
uniformly; 

2 5 

d) using the expansion e* = 1+ 4 + 4, +--+ and Euler’s formula e'* = cos x + 

isinx, show that 


1+ ii Go. ae = e* cos(sinx), 
sin x sinnx Gee: at hatal 
aC eS e°S* sin(sin x); 
A é 22 ad $ 23 2 
e) using the expansions cosz = 1— 4+ 4, —--- andsing=z—4+G—-*, 


verify that 


= sin(cos x) cosh(sin x), 


+ IY" cos(2n + DE 
rah (2n + 1)! 


= sin(cos x) sinh(sin x), 


s y" sin(2n + Dt 
am (2n + 1)! 
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(oe) 

1 COS 2NX : 
xe) = cos(cos x) cosh(sin x), 
n=0 


(Qn)! 
s ‘je _ ( \snh (ing) 
dX = On} = cos(cos x) sinh(sin x). 


5. Verify that 


a) the systems {1, coskx, sink x; k € N} and {elk Fx, k € Z} are orthogonal 


in the space R2([a,a +7], C) for every a € R; 

b) the Fourier coefficients ax(f), by(f), and cx(f) of a T-periodic function f 
in these systems are the same whether the Fourier expansion is done on the interval 
[-4, q] or any other closed interval of the form [a, a + T]; 

c) if cg(f) and cx(g) are the Fourier coefficients of T-periodic functions f and 
g, then 


1 a+T es) 
a : f (x)E(x) dx = Dc ( Pex Cg); 


d) the Fourier coefficients cz (4) normalized by the factor r of the “convolution” 


1 T 
h(x) == / f(x —Ng(t)dt 
T Jo 
of T-periodic smooth functions f and g and the coefficients cx, (f) and cz (g) of the 
functions themselves are related by cx (h) = cx(f )ck(g), k € Z. 
6. Prove that if ~ is incommensurable with zr, then 
a) limy-soo 7 oy efk(rtna) — + jee ef kt dr: 


b) for every continuous 27 -periodic function f :R— C 


N 8 
fae S> f(x +na) = =| f(t) dt 
Noo N = 2m Jn , 
7. Prove the following propositions. 


a) If the function f : RR — C is absolutely integrable on R, then 


if flayel* dx ae y(«+ *) ~ f(x) 


b) If the functions f :R— C and g: R— C are absolutely integrable on R and 
g is bounded in absolute value on R, then 


dx. 


(oe) 
i. f(x tn g(nel™ dt =:9,(x) 30 onRasrA> oo. 
—0o 
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c) If f : R— C is a 27-periodic function that is absolutely integrable over a 
period, then the remainder S,,(x) — f(x) of its trigonometric Fourier series can be 
represented as 


1 7 ) 
Si(s)— Foy== [ (A*/)G.NDA at 


where D,, is the nth Dirichlet kernel, and (AFG, th= fx~+t) -—2f(~) + 
Fea. 

d) For every 6 € ]0,2[ the formula for the remainder just obtained can be 
brought into the form 


1 /° sinnt 4 
Sys) - fsy== f —(4 f)(x, t) dt + 0(1), 


where o(1) trends to zero as n — ov, and uniformly on each closed interval [a, b] 
on which f is bounded. 

e) If the function f :[—z,2] — C satisfies the Hdlder condition | f(x,) — 
Ff (x2)| < M|x, — x2|* on [—z, 2] (where M and @ are positive numbers) and in 
addition f(—z) = f(z), then the Fourier series of f converges to it uniformly on 
the entire interval. 


8. a) Prove that if f : R— R is a 27-periodic function having a piecewise contin- 
uous derivative f”) of order m (m € N), then f can be represented as 


foy= 4 +2 f° Bat -os™@a, 


where By, (u) = Y--~ a meN. 

b) Using the Fourier series expansion obtained in Problem | for the function 
[0, 27r], prove that B; (uw) is a polynomial of degree | and B,, (u) 
is a polynomial of degree m on the interval [0, 277]. These polynomials are called 
the Bernoulli polynomials. 


c) Verify that i Bm (u) du = 0 for every m €N. 


9. a) Let xm = 22,m=0,1,..., 2n. Verify that 


2n+1? 
2 2n 
Salad ai > coskxm coslxm = dx, 
m=0 
2n 
eae aod Xu sinkx, sinlxm = dx, 


m= 
2n 
y sinkxm coslx» = 0, 


m=0 


where k and / are nonnegative integers, 6,; = 0 for k £1, and dx; = 1 fork =1. 
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b) Let f : R— R be a 27-periodic function that is absolutely integrable over 
a period. Let us partition the closed interval [0, 27] into 2n + 1 equal parts by the 


points xX, = an, m=0,1,...,2n. Let us compute the integrals 
1 20 1 20 
ar(f) = — f(x) coskx dx, be (f) = — f(x) sinkx dx 
TH JO T JO 


approximately using the rectangular method corresponding to this partition of the 
interval [0, 277]. We obtain the quantities 


2n 

if) = Sz De Fm) cos kx, 
m=0 

_ 2n 

be A) = Sz LL Fn) sin km, 
m=0 


which we place in the nth partial sum S,,(f, x) of the Fourier series of f instead of 
the respective coefficients a,(f) and by (f). 

Prove that when this is done the result is a trigonometric polynomial Sn( f, x) of 
order n that interpolates the function f at the nodes x,,,m =0,1,..., 27, that is, at 
these points f(x) = S.. (x,m). 


10. a) Suppose the function f : [a,b] — R is continuous and piecewise differen- 
tiable, and suppose that the square of its derivative f’ is integrable over the interval 
Ja, b[. Using Parseval’s equality, prove the following: 


a) if [a,b] = [0,7], then either of the conditions f(0) = f(z) = 0 or 
to. J (x) dx = 0 implies Steklov’s inequality 


de f° (x) dx < [uve dx, 
0 0 


in which equality is possible only for f(x) = acosx; 
b) if [a, b] =[—7z, 7] and the conditions f(—z) = f(z) and < f(x) dx =0 
both hold, then Wirtinger’s inequality holds: 


‘i f(x) dx < a (f') (x) de, 


—T KH 
where equality is possible only if f(x) =acosx + bsinx. 


11. The Gibbs phenomenon is the behavioral property of the partial sums of a 
trigonometric Fourier series described below, first observed by Wilbraham (1848) 
and later (1898) rediscovered by Gibbs (Mathematical Encyclopedia, Vol. 1, 
Moscow, 1977). 
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a) Show that 


4S sin(2k — 1 
sgnx = = » “— i Mi for |x| <z. 


b) Verify that the function S,(x) = 4 ei sinCk-Dx has a maximum at x = = 


and that as n > oo 


2 sink — 1) 2 7 si 
S12 -\e > ( 3 ee / ame dx © 1.179. 
2n eT (2Qk—1)5-  n rJo Xx 


Thus the oscillation of S,(x) near x = 0 as n — oo exceeds the jump of the 
function sgn x itself at that point by approximately 18 % (the jump of S,,(x) “due to 
inertia’). 

c) Describe the limit of the graphs of the functions S, (x) in problem b). 

Now suppose that S,(f, x) is the nth partial sum of the trigonometric Fourier 
series of a function f and suppose that S,(f,x) — f(x) ina deleted neighborhood 
0 < |x —&| <6 of the point € asm — ow and that f has one-sided limits f(€_) and 
f (4) at &. For definiteness we shall assume that f(&_) < f(&4). 

We say that Gibbs’ phenomenon occurs for the sums S,(f, x) at the point & if 
lim, 0 Sn (f.) < FE) < FEL) < Tit 500 Sn(f,)- 

d) Using Remark 9 show that Gibbs’ phenomenon occurs at the point € for 
every function of the form g(x) + csgn(x — &), where c 4 0, |&| < a, and ge 
Colm, x]. 


12. Multiple trigonometric Fourier series. 


a) Verify that the system of functions On 7 as rel , where k = (kj,...,kn), X= 
(X1,---,Xn), kx =kyxy +--+ + kyxp, and kj,...,k, € Z, is orthonormal on any 
n-dimensional cube J = {x € IR" | aj <xj <aj+ on P= UW 2yasig nh: 


b) To a function f that is integrable over J we assign the sum f ~ 
a mon ECP), which is called the Fourier series of f in the system {oan elk} 


if cx(f) = onyn ted f (x)e"* dx. The numbers cx(f) are called the Fourier coef- 


ik - 
ficients of f in the system lana en} 


In the multidimensional case the Fourier series is often summed via the partial 
sums 


Swix) = D> ce(fye™, 


|k|<N 


where |k| < N means that VN = (Nj,..., Nx) and |k;|< Nj, jHl1,...,n 
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Show that for every function f(x) = f(x1,...,%,) that is 27-periodic in each 
variable 


1 
Sn(x) = an I Dy, (tj —xj) f@dt= 


-<|'- of reo] ] Dw (t;) dt, ---dtn, 


where D Nj (u) is the N;th one-dimensional Dirichlet kernel. 
c) Show that the Fejér sum 


N Ni n 
1 1 
on (x) Nol 2 k(x) (WFD. (N+ D ps oD ke ssekin (X) 
= LS n= 
of a function f(x) = f(x1,...,%X,) that is 27-periodic in each variable can be rep- 


resented as 
1 
oven) =< | fe-non (tar 
mu” JI 


where ®y (u) = TTj=1 Fy ;,(uj) and Fy, is the N;th one-dimensional Fejér kernel. 

d) Now extend Fejér’s theorem to the n-dimensional case. 

e) Show that if a function f that is 27r-periodic in each variable is absolutely 
integrable over a period J, possibly in the improper sense, then [ pIf@ +4) - 
f (x)| dx > Oas u > Oand f,| f — on|(x) dx > 0 as N > 00. 

f) Prove that two functions f and g that are absolutely integrable over the cube 
TI can have equal Fourier series (that is, cx(f) = c.g) for every multi-index k) only 
if f(x) = g(x) almost everywhere on /. This is a strengthening of Proposition 3 on 
uniqueness of Fourier series. 


g) Verify that the original orthonormal system { kx) ig complete in 


a nf2& 
R2(Z), so that the Fourier series of every function f ay (J) converges to f in 
the mean on /. 

h) Let f be a function in C (CO) QR") of period 27 in each variable. Verify that 
ce(f ™) = i!lk%cg(f), where a = (a1,..., Qn), k = (k1,...,kn), la] = Joy] + 

-»+lan|,k% = ie -...+ke", and a; are nonnegative integers. 

i) Let f be a function of class C’””) (R”) of period 27 in each variable. Show 

that if the estimate 


(a) 2 
aby ferns 


holds for each multi-index a = (a, ...,@,) such that a; is 0 or m (for every j = 
1,...,n), then 


CM 
| F(@) — Su(x)| < —, 
N™~2 
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where N = min{Nj,..., N,} and C is a constant depending on m but not on N or 
xel, 

j) Notice that if a sequence of continuous functions converges in mean on the 
interval J toafunction f and simultaneously converges uniformly to g, then f(x) = 
g(x) on I. 

Using this observation, prove that if a function f : R” — C of period 27 in 
each variable belongs to C“) (R”, C), then the trigonometric Fourier series of f 
converges to f uniformly on the entire space R”. 


13. Fourier series of generalized functions. Every 27 -periodic function f : R— C 
can be regarded as a function f(s) of a point on the unit circle I” (the point is fixed 
by the value of the arc-length parameter s, 0 < s < 277). 

Preserving the notation of Sect. 17.4, we consider the space D(J") on I” consist- 
ing of functions in C (CO) (7) and the space D’(I”) of generalized functions, that is, 
continuous linear functionals on D(I”). The value of the functional F € D’/(I”) on 
the function g € D(J’) will be denoted Fg), so as to avoid the symbol (F, g) used 
in the present chapter to denote the Hermitian inner product (18.38). 

Each function f that is integrable on I” can be regarded as an element of D’(I”) 
(a regular generalized function) acting on the function g € D(J”) according to the 
formula 

20 


f{@= : f(s)p(s) ds. 


Convergence of a sequence {F,,} of generalized functions in D’(I”) to a general- 
ized function F € D’(I’), as usual, means that for every function g € D(I”) 


lim F,(g) = F(@). 
noo 


a) Using the fact that by Theorem 5 the relation g(s) = eam Ck (p)eik* holds 


for every function g € C (O(), and, in particular, g(0) = a ck(~), show that 
in the sense of convergence in the space of generalized functions D’(I”) we have 


Here 6 is the element of D’(I”) whose effect on the function g € D() is defined 
by 5(y) = (0). . 

b) If f € RW), the Fourier coefficients of the function f in the system {el*s} 
defined in the standard manner, can be written as 


20 


1 1 
a =o fp fee dx =o Fe). 


By analogy we now define the Fourier coefficients cy(F) of any generalized 
function F € D’(I) by the formula c,(F) = nF (e~'*), which makes sense be- 


cause e!*5 € D(L). 
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Thus to every generalized function F € D’(I”) we assign the Fourier series 


[o@) 
Fr a cy (Fyel*. 


—oo 


Show that 6 ~ }°°. aelks 

c) Prove the following fact, which is remarkable for its simplicity and the free- 
dom of action that it provides: the Fourier series of every generalized function 
F € D'(I) converges to F (in the sense of convergence in the space D’(I")). 

d) Show that the Fourier series of a function F € D’(I’) (like the function F it- 
self, and like every convergent series of generalized functions) can be differentiated 
termwise any number of times. 

e) Starting from the equality 5 = )°~, = 

f) Let us now return from the circle I to the line R and study the functions e 
as regular generalized functions in D’(R) (that is, as continuous linear functionals 
on the space D(R) of functions in the class ee (R) of infinitely differentiable 
functions of compact support in R). 

Every locally integrable function f can be regarded as an element of D’(R) 
(a regular generalized function in D’(R)) whose effect on the function g € 
COR, C) is given by the rule f(g) = aes f (x)g(x) dx. Convergence in D’(R) 
is defined in the standard way: 


e/ks | find the Fourier series of 8’. 
iks 


(lim Fr =F) :=Ve € DR) (lim Fr) = F@)). 


Show that the equality 
1 [o,@) [o.@) 
— ) ve =)" 8(x — 2k) 


20 
—0o —0o 


holds in the sense of convergence in D’(R). In both sides of this equality a limiting 
passage is assumed as n —> oo over symmetric partial sums }“",,, and 5(x — x9), 
as always, denotes the 5-function of D’(R) shifted to the point xo, that is, d(x — 
xo) (Y) = P(xo). 


18.3 The Fourier Transform 


18.3.1 Representation of a Function by Means of a Fourier 
Integral 


a. The Spectrum and Harmonic Analysis of a Function 


Let f(t) be a T-periodic function, for example a periodic signal with frequency t 
as a function of time. We shall assume that the function f is absolutely integrable 
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over a period. Expanding f in a Fourier series (when f is sufficiently regular, as we 
know, the Fourier series converges to f) and transforming that series, 


fo= wot) + Sv ar(f) coskaot + by(f) sinkwot = 
k=1 
= ye cxf eikoot =co +2 > |cx| cos(kw@ot + argcx), (18.78) 
—oo k=1 


we obtain a representation of f as a sum of a constant term o = co — the mean 


value of f over a period — and sinusoidal components with frequencies v9 = 4 (the 
fundamental frequency), 2vo (the second harmonic frequency), and so on. In general 
the kth harmonic component 2\cx| cos(k#t + argc,) of the signal has frequency 


kvg = i, cyclic frequency kwp = 21kvp = 2k, amplitude 2|cx| = eae + ie and 


= be 
phase arg cy = — arctan a 


The expansion of a periodic function (signal) into a sum of simple harmonic 
oscillations is called the harmonic analysis of f. The numbers {c,(f); k € Z} or 
{ao(f), ax(f), be (f); k € N} are called the spectrum of the function (signal) f. 
A periodic function thus has a discrete spectrum. 

Let us now set out (on a heuristic level) what happens to the expansion (18.78) 
when the period T of the signal increases without bound. 

Simplifying the notation by writing / = f and a, = k7, we rewrite the expansion 


CO 
fo= > ae 
—0o 
as follows: 
= I oA 
t)= Sere, 18.79 
f(t) D(az)e (18.79) 
where 
1 f! ; 
= fe ue 
k= > [ir Je 
and hence 
l 1 f 
a= 5 f f@e'™ dt. 
xz 20 J_y 


Assuming that in the limit as / — +00 we arrive at an arbitrary function f that 
is absolutely integrable over R, we introduce the auxiliary function 


c(a) = =|. Fine di, (18.80) 
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whose values at points w = a differ only slightly from the quantities c; L in formula 
(18.79). In that case 


[ee 


forxy> clay ei =, (18.81) 


—oo 


where a, = k> and ay41 — a, = F. This last integral resembles a Riemann sum, 
and as the partition is refined, which occurs as | > oo, we obtain 


f(t) =i c(aje!™ dav. (18.82) 


—oo 


Thus, following Fourier, we have arrived at the expansion of the function f into 
a continuous linear combination of harmonics of variable frequency and phase. 

The integral (18.82) will be called the Fourier integral below. It is the continuous 
equivalent of a Fourier series. The function c(q@) in it is the analog of the Fourier 
coefficient, and will be called the Fourier transform of the function f (defined on the 
entire line R). Formula (18.80) for the Fourier transform is completely equivalent to 
the formula for the Fourier coefficients. It is natural to regard the function c(a@) as 
the spectrum of the function (signal) f . In contrast to the case of a periodic signal f 
considered above and the discrete spectrum (of Fourier coefficients) corresponding 
to it, the spectrum c(@) of an arbitrary signal may be nonzero on whole intervals 
and even on the entire line (continuous spectrum). 


Example I Let us find the function having the following spectrum of compact sup- 
port: 
h, if |a|<a, 


= {0 if |a| >a. ee 


Proof By formula (18.82) we find, for t 4 0 


iat _ ,—iat 


fo= | hel da = h-— =2h ; (18.84) 


-~a It t 


and when t = 0, we obtain f(0) = 2ha, which equals the limit of 2h nat as 
t—> 0. 


The representation of a function in the form (18.82) is called its Fourier integral 
representation. We shall discuss below the conditions under which such a represen- 
tation is possible. Right now, we consider another example. 


Example 2 Let P be a device having the following properties: it is a linear signal 
transform, that is, PO ayfp= LaF a; P(fj;), and it preserves the periodicity of 
a signal, that is, P(e'®’) = p(w)e'®, where the coefficient p(w) depends on the 
frequency w of the periodic signal e!@’. 
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We use the compact complex notation, although of course everything could be 
rewritten in terms of cos wt and sina. 

The function p(w) =: R(w)e'?) is called the spectral characteristic of the de- 
vice P. Its absolute value R(q@) is usually called the frequency characteristic and its 
argument y(@) the phase characteristic of the device P. A signal e’’, after passing 
through the device, emerges transformed into the signal R(w)e!@!+?)), its ampli- 
tude changed as a result of the factor R(w) and its phase shifted due to the presence 
of the term g(w). 

Let us assume that we know the spectral characteristic p(w) of the device P and 
the signal f(t) that enters the device; we ask how to find the signal x(t) = P(f)(t) 
that emerges from the device. 

Representing the signal f(t) as the Fourier integral (18.82) and using the linear- 
ity of the device and the integral, we find 


oo . 
c(@) p(a)e' da. 
CO 


xn=Pno= f 


In particular, if 


1 for |@| <2, 


p(@)= if for ale, (18.85) 


then 
2 re 
x(t) -| c(w)e'™ dw 
—2 
and, as one can see from the spectral characteristics of the device, 


P(ci") = a for || < 2, 


0 for |w| > 2. 


A device P with the spectral characteristic (18.85) transmits (filters) frequencies 
not greater than $2 without distortion and truncates all of the signal involved with 
higher frequencies (larger than £2). For that reason, such a device is called an ideal 
low-frequency filter (with upper frequency limit S2) in radio technology. 

Let us now turn to the mathematical side of the matter and to a more careful study 
of the concepts that arise. 

b. Definition of the Fourier Transform and the Fourier Integral 


In accordance with formulas (18.80) and (18.82) we make the following definition. 


Definition 1 The function 
1 ¢& . 
FLAME) = 5 | Fore dx (18.86) 
27 Joo 


is the Fourier transform of the function f :R— C. 
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The integral here is understood in the sense of the principal value 


lee) ; A : 
: f(x)e"8* dx := lim / f (x)e"8* dx, 
—oo A>+0o0 J_A 


and we assume that it exists. 

If f : R > C is absolutely integrable on R, then, since | f (x)e~'*5| = | f (x)| for 
x,é& €R, the Fourier transform (18.86) is defined, and the integral (18.86) converges 
absolutely and uniformly with respect to € on the entire line R. 


Definition 2 If c(é) = F[f](&) is the Fourier transform of f : R — C, then the 
integral assigned to f, 


CO 
f(a) i c(é)e"** dé, (18.87) 
—0o 
understood as a principal value, is called the Fourier integral of f. 


The Fourier coefficients and the Fourier series of a periodic function are thus the 
discrete analog of the Fourier transform and the Fourier integral respectively. 


Definition 3 The following integrals, understood as principal values, 
Fasuey=— f fs)eoséx at. (18.88) 


FLfIE) = =f. f(x) sinéx dx, (18.89) 


are called respectively the Fourier cosine transform and the Fourier sine transform 
of the function f/f. 


Setting c(§) = FLF1(), a(€) = FcL f1), and b(E) = Fs[f]), we obtain the 


relation that is already partly familiar to us from Fourier series 


cE) = $(aé) — ib(é)). (18.90) 

As can be seen from relations (18.88) and (18.89), 
a(—§) =a), b(—€) = —b@). (18.91) 
Formulas (18.90) and (18.91) show that Fourier transforms are completely de- 


termined on the entire real line R if they are known for nonnegative values of the 
argument. 
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From the physical point of view this is a completely natural fact — the spectrum 
of a signal needs to be known for frequencies w > 0; the negative frequencies a in 
(18.80) and (18.82) — result from the form in which they are written. Indeed, 


A . 0 A , A : ; 
} cee ag = ( f + i oceyet* af = - (c(éel** + c(—&)e!**) dé = 
—A —A 0 0 


A 
=| (a(E) cos x& + b(E) sinxE) dé, 
0 


and hence the Fourier integral (18.87) can be represented as 


[ee covre + b(é) sin xé) dé, (18.87’) 
0 


which is in complete agreement with the classical form of a Fourier series. If the 
function f is real-valued, it follows from formulas (18.90) and (18.91) that 


c(—&) =c(), (18.92) 


since in this case a(€) and b(&) are real-valued functions on R, as one can see 
from their definitions (18.88) and (18.89). On the other hand, under the assumption 
f(x) = f(x), Eq. (18.92) can be obtained immediately from the definition (18.86) 
of the Fourier transform, if we take into account that the conjugation sign can be 
moved under the integral sign. This last observation allows us to conclude that 


FIf\(—€) = FIFE) (18.93) 


for every function f :R— C. 
It is also useful to note that if f is a real-valued even function, that is, f(x) = 
f(x) = f(—x), then 
FeLFIE) = Fel PIE), Fs[f1E) =0, 


FIFI) = FLFIE) = FUP); 


(18.94) 


and if f is a real-valued odd function, that is, f(x) = f(x) = —f(—~), then 


FASE) =90, = Fslf1E) =Fsl(F1E), 


FLFIE) = —FLFIE) = FLFM-€); 


(18.95) 


and if f is a purely imaginary function, that is, f(x) = —f (x), then 


FLFfM—-€) = -F FIG). (18.96) 
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We remark that if f is a real-valued function, its Fourier integral (18.87’) can 
also be written as 


[ y a7 (E) + b?(&) cos(xé + y(E)) dé =2f |c(E)| cos(xé + p(&)) dé, 


where y(€) = — arctan a =argc(é). 


Example 3 Let us find the Fourier transform of f(t) = sult (assuming f(0) = 
aeéR). 


? 1 A sinat iat 
Fifl(@) = lim — =e dt = 
—A 


= lim = 
A>+0o0 27 J_4 t 20 


1 t* (=s + a)t i sin(a — =) 
t 


~ In Jo t 


1 [4 sinatcosat 2 [*™ sinatcosat 
dt = dt 
0 t 


dt = 


‘ 1 : 
~ sinu 4 | Isena,_ if |a| <|al, 


1 
= —(sen(a+a)+sen(a—a 
Fg SEN(a +) + sent » | 0, if || > Jal, 


since we know the value of the Dirichlet integral 


© sinu T 
as (pes (18.97) 
0 2 


u 


Hence if we assume a > 0 and take the function f(t) = 2h nat of Eq. (18.84), 
we find, as we should have expected, that the Fourier transform is the spectrum of 
this function exhibited in relations (18.83). 

The function f in Example 3 is not absolutely integrable on R, and its Fourier 
transform has discontinuities. That the Fourier transform of an absolutely integrable 
function has no discontinuities is attested by the following lemma. 


Lemma 1 /f the function f :1R > C is locally integrable and absolutely integrable 
on R, then 


a) its Fourier transform F(f \(&) is defined for every value — € R; 
b) FIfle CR, ©); 

c) sup; |FIgl(@)1 < + f°, |f @l dx; 

d) F[f](é) ~ OasE > cw. 


Proof We have already noted that | f (x)e!*5| < | f(x)|, from which it follows that 
the integral (18.86) converges absolutely and uniformly with respect to € € R. This 
fact simultaneously proves parts a) and c). 

Part d) follows from the Riemann—Lebesgue lemma (see Sect. 18.2). 
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For a fixed finite A > 0, the estimate 


A A 
if faerer _ e 5) dx < sup leo = iif | f (x)| dx 
jf =A 


|x|<A 


establishes that the integral 


i. 4 ; 
ue : f(xje5 dx, 
20 =A 


is continuous with respect to €; and the uniform convergence of this integral as 
A — +00 enables us to conclude that F[f] € C(R, C). 


Example 4 Let us find the Fourier transform of the function f(t) =e’ */2, 


2 ‘ TOO. x9 
erie it a= [ e' /? cosat dt. 
—0CO 


+00 
Fira) = [ 


—oo 


Differentiating this last integral with respect to the parameter a and then inte- 
grating by parts, we find that 


dF 
a) +aF Ifa) =0, 
Ol 


or 


Fe =-a. 
da 


It follows that F[ f](@) = cen / ? where c is a constant which, using the Euler— 
Poisson integral (see Example 17 of Sect. 17.2) we find from the relation 


+00 
c= F[f1() =) el)? at = Jn, 


—oo 


Thus we have found that F[ f](@) = /27 ee / 2 and simultaneously shown that 
F.Lf\(a) = /2ne—*/? and F,[ f(a) = 0. 


c. Normalization of the Fourier Transform 


We obtained the Fourier transform (18.80) and the Fourier integral (18.82) as the 
natural continuous analogs of the Fourier coefficients cz, = = Jo f (x)eik dx 
and the Fourier series )>*, cxe! of a periodic function f in the trigonometric 
system {e!“*; k € Z}. This system is not orthonormal, and only the ease of writing 
a trigonometric Fourier series in it has caused it to be used traditionally instead of 
the more natural orthonormal system (seel™ k € Z}. In this normalized system 
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the Fourier series has the form bee Ck ame, and the Fourier coefficients are 
IT 


defined by the formulas ¢, = Tz (eed (xje!* dx. 


The continuous analogs of such natural Fourier coefficients and such a Fourier 
series would be the Fourier transform 


f@)= = [ . foe" dx (18.98) 
and the Fourier integral 
1 Oe rec 
= aes ix8 dg, 18.99 
f=sa |] fee ae (18.99) 


which differ from those considered above only in the normalizing coefficient. 

In the symmetric formulas (18.98) and (18.99) the Fourier “coefficient” and the 
Fourier “series” practically coalesce, and so in the future we shall essentially be 
interested only in the properties of the integral transform (18.98), calling it the nor- 
malized Fourier transform or, where no confusion can arise, simply the Fourier 
transform of the function f. 

In general the name integral operator or integral transform is customarily given 
to an operator A that acts on a function f according to a rule 


A(f)(y) = iA K(x, yf) dx, 


where K(x, y) is a given function called the kernel of the integral operator, and 
X C R" is the set over which the integration extends and on which the integrands 
are assumed to be defined. Since y is a free parameter in some set Y, it follows that 
A(f) is a function on Y. 

In mathematics there are many important integral transforms, and among them 
the Fourier transform occupies one of the most key positions. The reasons for this 
situation go very deep and involve the remarkable properties of the transformation 
(18.98), which we shall to some extent describe and illustrate in action in the re- 
maining part of this section. 

Thus, we shall study the normalized Fourier transform (18.98). 

Along with the notation f for the normalized Fourier transform, we introduce 
the notation 


f(é) = —— ° 8X dy, 18.100 
f() cae a OP ( ) 


that is, f(€) = f(-&). 
Formulas (18.98) and (18.99) say that 
fofef, (18.101) 


that is, the integral transforms (18.98) and (18.99) are mutually inverse to each other. 
Hence if (18.98) is the Fourier transform, then it is natural to call the integral oper- 
ator (18.100) the inverse Fourier transform. 
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We shall discuss in detail below certain remarkable properties of the Fourier 
transform and justify them. For example 


FM(E) = ie" FO). 
fxg=v2xf 8, 
Wf =I. 


That is, the Fourier transform maps the operator of differentiation into the op- 
erator of multiplication by the independent variable; the Fourier transform of the 
convolution of functions amounts to multiplying the transforms; the Fourier trans- 
form preserves the norm (Parseval’s equality), and is therefore an isometry of the 
corresponding function space. 

But we shall begin with the inversion formula (18.101). 

For another convenient normalization of the Fourier transform see Problem 10 
below. 


d. Sufficient Conditions for a Function to be Representable as a Fourier 
Integral 


We shall now prove a theorem that is completely analogous in both form and con- 
tent to the theorem on convergence of a trigonometric Fourier series at a point. 
To preserve the familiar appearance of our earlier formulas and transformations to 
the maximum extent, we shall use the nonnormalized Fourier transform c(é) in the 
present part of this subsection, together with its rather cumbersome but sometimes 
convenient notation F[f](&). Afterwards, when studying the integral Fourier trans- 
form as such, we shall as a rule work with the normalized Fourier transform f of 
the function f/f. 


Theorem 1 (Convergence of the Fourier integral at a point) Let f : R— C be an 
absolutely integrable function that is piecewise continuous on each finite closed 
interval of the real axis R. 

If the function f satisfies the Dini conditions at a point x € R, then its Fourier 
integral (18.82), (18.87), (18.87’), (18.99) converges at that point to the value 
5(f (x-) + f(x+)), equal to half the sum of the left and right-hand limits of the 
function at that point. 


Proof By Lemma | the Fourier transform c(€é) = F[f](€) of the function f is con- 
tinuous on R and hence integrable on every interval [—A, A]. Just as we transformed 
the partial sum of the Fourier series, we now carry out the following transformations 
of the partial Fourier integral: 


A . A 1 ee) : : 
Sa(x) = : c(é)el* dé = / (= : fie = are dé = 
=A =A Qn —0o 
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al. ro( [i « eft ap) ar = 


lee) ela tA _ e I-A 


~ On J _fo- i@ —f) 
aa 
= =f. for --f[- ean" 


1 sin A 
-{- (f(x —u) + fe +u))—— 


I 


dt = 


The change in the order of integration at the second equality from the beginning 
of the computation is legal. In fact, in view of the piecewise continuity of f, for 
every finite B > 0 we have the equality 


A 1 B . . 1 B 
/ (—/ fe" are dé = =|, rol fe ef 8 ae) dr, 
=A 20 —B 2a J 


from which as B — +00, taking account of the uniform convergence of the integral 


i f(x)e~"§ dt with respect to €, we obtain the equality we need. 
We now use the value of the Dirichlet integral (18.97) and complete our transfor- 
mation: 


soy — LE D+F _ 


_! [- (f@— uw) — f@-)+F@+H — fe4)) 
Tw Jo 


u 


sin Au du. 


The resulting integral tends to zero as A — oo. We shall explain this and thereby 
finish the proof of the theorem. 

We represent this integral as the sum of the integrals over the interval ]0, 1] and 
over the interval [1, +0o[. The first of these two integrals tends to zero as A > +00 
in view of the Dini conditions and the Riemann—Lebesgue lemma. The second inte- 
gral is the sum of four integrals corresponding to the four terms f(x —u), f(x +u), 
f(x_) and f (x1). The Riemann—Lebesgue lemma applies to the first two of these 
four integrals, and the last two can be brought into the following form, up to a con- 


stant factor: 
+°° sin Au + ciny 
du = — dv 
1 Uu A v 


But as A — +00 this last integral tends to zero, since the Dirichlet integral 
(18.97) converges. 


Remark I In the proof of Theorem | we have actually studied the convergence 
of the integral as a principal value. But if we compare the notations (18.87) and 
(18.87'), it becomes obvious that it is precisely this interpretation of the integral that 
corresponds to convergence of the integral (18.87’). 
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From this theorem we obtain in particular 


Corollary 1 Let f : R— C be a continuous absolutely integrable function. 

If the function f is differentiable at each point x € R or has finite one-sided 
derivatives or satisfies a Holder condition, then it is represented by its Fourier inte- 
gral. 


Hence for functions of these classes both equalities (18.80) and (18.82) or (18.98) 
and (18.99) hold, and we have thus proved the inversion formula for the Fourier 
transform for such functions. 

Let us consider several examples. 


Example 5 Assume that the signal v(t) = P(f)(t) emerging from the device P 
considered in Example 2 is known, and we wish to find the input signal f(t) entering 
the device P. 

In Example 2 we have shown that f and v are connected by the relation 


v(t) = [ c(w) p(a)e! da, 


—oo 


where c(w) = F[f](q@) is the spectrum of the signal F (the nonnormalized Fourier 
transform of the function f) and p is the spectral characteristic of the device P. 
Assuming all these functions are sufficiently regular, from the theorem just proved 
we conclude that then 


c(w) p(w) = F[v](@). 
From this we find c(w) = F[f](@). Knowing c(w), we find the signal f using 
the Fourier integral (18.87). 
Example 6 Let a > 0 and 


~4x for x > 0, 


e 
roy={ for x <0. 


Then 


FiIn@= 2 [eee a= 1 
oe =; / Oe Oe Gate 


In discussing the definition of the Fourier transform, we have already noted a 
number of its obvious properties in Part b of the present subsection. We note further 
that if f_ (x) := f(—x), then F[ f_](€) = F[f](—&). This is an elementary change 
of variable in the integral. 

We now take the function e~@!*! = f(x) + f(—x) =: g(x). 

Then 

a 


1 
Flgl€) = FLFIE) + FLPM-8) = — 5— 


mae 4&2" 
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If we now take the function w(x) = f(x) — f(— x), which is an odd extension 
of the function e~“*, x > 0, to the entire real line, then 
tb & 
a2 4&2" 


FIWI&) = FLFIE) — FLIP 8) = 


Using Theorem 1, or more precisely the corollary to it, we find that 


i 00 gixt a if x > 0, 
= de =} wr=U 
2 = * 2? 9 

md ep Gets 6 i#r<0. 


oe aeixé de = eth 


T J—oo a2 + &2 

b sacleggd sel e“, ifx>0, 
Ll e 

-{  - dé = } 0, ifx =0, 
™ Ts —e%, ifx <0. 


All the integrals here are understood in the sense of the principal value, although 
the second one, in view of its absolute convergence, can also be understood in the 
sense of an ordinary improper integral. 

Separating the real and imaginary parts in these last two integrals, we find the 
Laplace integrals we have encountered earlier 


[- cos xé dé = FE als 
0 a? + &2 2a ; 


TOO sinxé dé = Denaltl a 
» ate 8 ata 


Example 7 On the basis of Example 4 it is easy to find (by an elementary change of 
variable) that if 


2: 
f@)=e"*, then f(é)= ae 
J2a 

It is very instructive to trace the simultaneous evolution of the graphs of the func- 
tions f and a as the parameter a varies from 1/,/2 to 0. The more “concentrated” 
one of the functions is, the more “smeared” the other is. This circumstance is closely 
connected with the Heisenberg uncertainty principle in quantum mechanics. (In this 
connection see Problems 6 and 7.) 


Remark 2 In completing the discussion of the question of the possibility of repre- 
senting a function by a Fourier integral, we note that, as Examples | and 3 show, the 
conditions on f stated in Theorem | and its corollary are sufficient but not necessary 
for such a representation to be possible. 
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18.3.2 The Connection of the Differential and Asymptotic 
Properties of a Function and Its Fourier Transform 


a. Smoothness of a Function and the Rate of Decrease of Its Fourier 
Transform 


It follows from the Riemann—Lebesgue lemma that the Fourier transform of any 

absolutely integrable function on R tends to zero at infinity. This has already been 

noted in Lemma | proved above. We now show that, like the Fourier coefficients, 

the smoother the function, the faster its Fourier transform tends to zero. The dual 

fact is that the faster a function tends to zero, the smoother its Fourier transform. 
We begin with the following auxiliary proposition. 


Lemma 2 Let f : RR > C be a continuous function having a locally piecewise con- 
tinuous derivative f’ on R. Given this, 


a) if the function f’ is integrable on R, then f(x) has a limit both as x — —oo 
and as > +00; 
b) if the functions f and f' are integrable on R, then f(x) > 0 as > ov. 


Proof Under these restrictions on the functions f and f’ the Newton—Leibniz for- 
mula holds 


f)=fO+ i fade. 


In conditions a) the right-hand side of this equality has a limit both as x > +00 
and as x — —oo. 

If a function f having a limit at infinity is integrable on R, then both of these 
limits must obviously be zero. 


We now prove 
Proposition 1 (Connection between the smoothness of a function and the rate of 


decrease of its Fourier transform) If f ¢ C“(R, C) (k =0, 1, ...) and all the func- 
tions f, f’,..., f® are absolutely integrable on R, then 


a) for everyn € {0,1,...,k} 
FOE) = Ey" FE), (18.102) 
b) f(E) =o0(x) ast $0. 


Proof \f k = 0, then a) holds trivially and b) follows from the Riemann—Lebesgue 
lemma. 
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Let k > 0. By Lemma 2 the functions f, f’,..., f“~) tend to zero as x > oo. 
Taking this into account, we integrate by parts, 


PPE := Te [fe ar= 


Jon 
k 
_— Sf fe? dx = (it) fF). 


an Ge Dx jeer @ wef FV aye ax) a 


Thus Eq. (18.102) is established. This is a very important relation, and we shall 
return to it. . poke 
We have shown that f(§) = (i& )-* f®(E), but by the Riemann—Lebesgue 


lemma f(&) — 0 as € > 0 and hence b) is also proved. 


b. The Rate of Decrease of a Function and the Smoothness of Its Fourier 
Transform 


In view of the nearly complete identity of the direct and inverse Fourier transforms 
the following proposition, dual to Proposition 1, holds. 


Proposition 2 (The connection between the rate of decrease of a function and the 
smoothness of its Fourier transform) [fa locally integrable function f :R— C is 
such that the function x* f (x) is absolutely integrable on R, then 


a) the Fourier transform of f belongs to C®(R, C). 
b) the following equality holds: 


FOE = DEFOE. (18.103) 


Proof For k = 0 relation (18.103) holds trivially, and the continuity of f (€) has 
already been proved in Lemma |. If k > 0, then for n < k we have the estimate 
|x” f(x)| < |x* f(x)| at infinity, from which it follows that x” f(x) is absolutely 
integrable. But |x” f (x)e7‘§*| = |x” f (x)|, which enables us to invoke the uniform 
convergence of these integrals with respect to the parameter € and successively dif- 
ferentiate them under the integral sign: 


iz 1 = ey 
fO=se f Fe dr, 
Jn - 


oo i¢ 
xf (x)e!5* dx, 


PO=— | J 
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_ayk lee) 
f©O= — i. xk Oxje7i8* de. 


By Lemma | this last integral is continuous on the entire real line. Hence indeed 
feCMR,C). 


c. The Space of Rapidly Decreasing Functions 


Definition 4 We denote the set of functions f ¢ C‘©)(R, C) satisfying the condi- 
tion 


sup|x? f™ (x)| <0O 
xeER 


for all nonnegative integers a and 6 by S(R, C) or more briefly by S. Such functions 
are called rapidly decreasing functions (as x — 00). 


The set of rapidly decreasing functions obviously forms a vector space under the 
standard operations of addition of functions and multiplication of a function by a 
complex number. 


=x 


Example § The function e : or, for example, all functions of compact support in 


CR, C) belong to S. 


Lemma 3 The restriction of the Fourier transform to S is a vector-space automor- 
phism of S. 


Proof We first show that (f € S) > (f € S$). 

To do this we first remark that by Proposition 2a we have f € C)(R, C). 

We then remark that the operation of multiplication by x“ (@ > 0) and the oper- 
ation D of differentiation do not lead outside the class of rapidly decreasing func- 
tions. Hence, for any nonnegative integers a and f the relation f € S implies that 
the function D* (x% f (x)) belongs to the space S. Its Fourier transform tends to zero 
at infinity by the Riemann—Lebesgue lemma. But by formulas (18.102) and (18.103) 


DP (x f (&)) E) = it *FEF FO], 


and we have shown that Eh f@) (E) > Oas E > o~, that is, Fa eS. 

We now show that § = S$ , that is, that the Fourier transform maps S onto the 
whole space S. 

We recall that the direct and inverse Fourier transforms are connected by the 
simple relation f (§)= 7 (—&). Reversing the sign of the argument of the function 
obviously is an operation that maps the set S into itself. Hence the inverse Fourier 
transform also maps S into itself. 

Finally, if f is an arbitrary function in S, then by what has been proved g = f eS 
and by the inversion formula (18.101) we find that f = @. 
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The linearity of the Fourier transform is obvious, so that Lemma 3 is now com- 
pletely proved. 


18.3.3, The Main Structural Properties of the Fourier Transform 


a. Definitions, Notation, Examples 


We have made a rather detailed study above of the Fourier transform of a function 
f :R-— C defined on the real line. In particular, we have clarified the connection 
that exists between the regularity properties of a function and the corresponding 
properties of its Fourier transform. Now that this question has been theoretically an- 
swered, we shall study the Fourier transform only of sufficiently regular functions 
so as to exhibit the fundamental technical properties of the Fourier transform in con- 
centrated form and without technical complications. In compensation we shall con- 
sider not only one-dimensional but also the multi-dimensional Fourier transform and 
derive its basic properties practically independently of what was discussed above. 

Those wishing to confine themselves to the one-dimensional case may assume 
that n = 1 below. 


Definition 5 Suppose f : R” —> C isa locally integrable function on R”. The func- 
tion 


f®:= > i flaje FE”) dx (18.104) 


(20 - 


is called the Fourier transform of the function f . 


Here we mean that x = (x1, ere ist ig) Xn)s é = (&1, mle En), (§, x) = &1x] ape ad +EnXn, 
and the integral is regarded as convergent in the following sense of principal value: 


[oltre der dig = lim f af Q(X1,...,Xn) dx, -- 
Md A—-+00 


In this case the multidimensional Fourier transform (18.104) can be regarded as n 
one-dimensional Fourier transforms carried out with respect to each of the variables 
X15 +++, Xn- 

Then, when the function f is absolutely integrable, the question of the sense in 
which the integral (18.104) is to be understood does not arise at all. 


Let a = (q,...,@,) and 6 = (f1,..., By) be multi-indices consisting of non- 
negative integers a;,B;, j = 1,...,n, and suppose, as always, that D® denotes 
: itis la| 
the differentiation operator ae of order Ja] := a) + -++ +a, and x? := 
Xp OXp 
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Definition 6 We denote the set of functions f € CR”, C) satisfying the condi- 
tion 


sup |x? D* f(x)| <0o 
xeER" 


for all nonnegative multi-indices a and f by the symbol S(R”, C), or by S where no 
confusion can arise. Such functions are said to be rapidly decreasing (as x —> 00). 

The set S with the algebraic operations of addition of functions and multiplica- 
tion of a function by a complex number is obviously a vector space. 


Example 9 The function en kD where |x|? = ee theese a; and all the functions in 


C (R”, C) of compact support belong to S. 

If f ¢ S, then integral in relation (18.104) obviously converges absolutely and 
uniformly with respect to € on the entire space R”. Moreover, if f € S, then by stan- 
dard rules this integral can be differentiated as many times as desired with respect 
to any of the variables 1,..., &). Thus if f € S, then fe C™ (R, C). 


Example 10 Let us find the Fourier transform of the function exp(—|x|*/2). When 
integrating rapidly decreasing functions one can obviously use Fubini’s theorem and 
if necessary change the order of improper integrations without difficulty. 

In the present case, using Fubini’s theorem and Example 4, we find 


1 
(27 )n/2 


I 1 ‘ie =12/2,-i8sx) ay id -3/2 _ -1e?/2 
— ree, e "i e en eae | j= e J = ¢ 5 


We now state and prove the basic structural properties of the Fourier transform, 
assuming, so as to avoid technical complications, that the Fourier transform is being 
applied to functions of class S. This is approximately the same as learning to operate 
(compute) with rational numbers rather than the entire space R all at once. The 
process of completion is of the same type. On this account, see Problem 5. 


/ eo 2/2, gE) gy — 


b. Linearity 

The linearity of the Fourier transform is obvious; it follows from the linearity of the 
integral. 

c. The Relation Between Differentiation and the Fourier Transform 

The following formulas hold 


Df) =ille* fe), (18.105) 
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(x f(&))(€) = "1D? fe). (18.106) 


Proof The first of these can be obtained, like formula (18.102), via integration by 
parts (of course, with a preliminary use of Fubini’s theorem in the case of a space R” 
of dimension n > 1). 

Formula (18.106) generalizes relation (18.103) and is obtained by direct differ- 
entiation of (18.104) with respect to the parameters &1,..., &). 


Remark 3 In view of the obvious estimate 


FO] < oor [| |Fen|dx < +00, 


1 
(27 )n/2 


it follows from (18.105) that f (€) > 0 as € > ow for every function f € S, since 
D°f eS. 

Next, the simultaneous use of formulas (18.105) and (18.106) enables us to write 
that 


DB (x f(x) (€) = D+ Fle’ D* fe), 


from which it follows that if f € S, then for any nonnegative multi-indices a and B 
we have £8 D® f (£) — 0 when & — oo in R”. Thus we have shown that 


(feS)>(feS). 


d. The Inversion Formula 


Definition 7 The operator defined (together with its notation) by the equality 


fae a f(xjeiE” dx, (18.107) 


a 


is called the inverse Fourier transform. 


The following Fourier inversion formula holds: 


~ A 
K = 


f=f=f, (18.108) 
or in the form of the Fourier integral: 
i(x,é) 
f= On awe |, feel dé. (18.109) 


Using Fubini’s theorem one can immediately obtain formula (18.108) from the 
corresponding formula (18.101) for the one-dimensional Fourier transform, but, as 
promised, we shall give a brief independent proof of the formula. 
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Proof We first show that 


[, gE) f (Eel) dé = is a(E) f(x + y) dy (18.110) 


for any functions f, g € S(R, C). Both integrals are defined, since f, g € S and so 
by Remark 3 we also have f, g € S. 
Let us transform the integral on the left-hand side of the equality to be proved: 


[ se) FG dé = 


: i y i(x 
=[ O(a, fore"? ay e (8) ge = 


1 . 
= oon ff, g(—)e 169) ae) £0) dy = 


=f SySn ia = BO) FG4 yay. 
IR” R"” 


There is no doubt as to the legitimacy of the reversal in the order of integration, 
since f and g are rapidly decreasing functions. Thus (18.110) is now verified. 
We now remark that for every ¢ > 0 


1 i(y, 1 —i(y,u/e —nn 
were g(ebjelO* dé = sae [8 Ol? du =e" 8(y/e), 
so that, by Eq. (18.110) 
A gC) FEO dé = i (8 "ave fe + ydy = [ Sf + eu) du. 


Taking account of the absolute and uniform convergence with respect to ¢ of the 
extreme integrals in the last chain of equalities, we find, as e > 0, 


2(0) iu feel) ae = fox) / Site 
R? R? 


Here we set g(x) = e-X?/2 Tn Example 10 we saw that ¢(u) = e7l#’/2, Recall- 
ing the Euler—Poisson integral ee e* dx = ./m and using Fubini’s theorem, we 
conclude that jas eH? /2 du = (27)"/2, and as a result, we obtain Eq. (18.109). 


Remark 4 In contrast to the single equality (18.109), which means that Fi = f, re- 
lations (18.108) also contain the equality f . But this relation follows immediately 
from the one proved, since ff) = Fi-8) and f(—x) = F(x). 


18.3. The Fourier Transform 573 


Remark 5 We have already seen (see Remark 3) that if f € S, then f e€ S, and 
hence 7 é S also, that is, § C S and S C S. We now conclude from the relations 


fafa thaS=S=s. 


e. Parseval’s Equality 


This is the name given to the relation 


(fg) =(f, 8), (18.111) 


which in expanded form means that 


i Fooygenydr = ff FEE AE. (18.111') 
It follows in particular from (18.111) that 


IMP =RAHA ASIF. (18.112) 


From the geometric point of view, Eq. (18.111) means that the Fourier transform 
preserves the inner product between functions (vectors of the space S), and hence is 
an isometry of S. 

The name “Parseval’s equality” is also sometimes given to the relation 


I, fé)g(é) dé ay f(x)a(x) dx, (18.113) 


which is obtained from (18.110) by setting x = 0. The main Parseval equality 
(18.111) is obtained from (18.113) by replacing g with g and using the fact that 


(@) =8, since = Gand g=g=g. 


f. The Fourier Transform and Convolution 


The following important relations hold 


(Fug) = (2x)? f -2, (18.114) 
(F-g) = (20)? fx (18.115) 


(sometimes called Borel’s formulas), which connect the operations of convolution 
and multiplication of functions through the Fourier transform. 
Let us prove these formulas: 


Proof 


—_ 1 
(f *g\(é) = aoe fU * g)(x)e EG) dx = 
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-soR [, (/, f(x — yey) ay)e —1.%) qy — 
7 =r [acre ([ foe- yet ax) ay = 


-oon a g(ye “FE” (/, fw@e te au) dy= 
=f eore!®” feray= 0m"? FORE). 


The legitimacy of the change in order of integration is not in doubt, given that 


ges. 
Formula (18.115) can be obtained by a similar computation if we use the inver- 


sion formula (18.109). However, Eq. (18.115) can be derived from relation (18.114) 


already proved if we recall that f=f= f. f= fe F=f. and thatu-v=u-v, 
U*V=U*D~. 


Remark 6 If we set f and g in place of f and g in formulas (18.114) and (18.115) 
and apply the inverse Fourier transform to both sides of the resulting equalities, we 
arrive at the relations 


f-g=(Qn)-"(f #8), (18.114) 
f ¥g = (Q2n)"(f -8). (18.115’) 


18.3.4 Examples of Applications 


Let us now illustrate the Fourier transform (and some of the machinery of Fourier 
series) in action. 


a. The Wave Equation 


The successful use of the Fourier transform in the equations of mathematical physics 
is bound up (in its mathematical aspect) primarily with the fact that the Fourier 
transform replaces the operation of differentiation with the algebraic operation of 
multiplication. 

For example, suppose we are seeking a function u : R > R satisfying the equa- 
tion 


agu (x) + au") (x) +++» + anu(x) = f(x), 


where ao, ..., @, are constant coefficients and f is a known function. Applying the 
Fourier transform to both sides of this equation (assuming that the functions u and 
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f are sufficiently regular), by relation (18.105) we obtain the algebraic equation 
(ay (i)" + a1 (i8)" | +++ + an)aG) = FE) 


for a. After finding a(€) = J var from the equation, we obtain u(x) by applying the 
inverse Fourier transform. 

We now apply this idea to the search for a function u = u(x, ft) satisfying the 
one-dimensional wave equation 


du au 
qt gg @>O 


and the initial conditions 


ou 
u(x,0) = f(x), qe ee 


inRxR. 

Here and in the next example we shall not take the time to justify the intermediate 
computations because, as a rule, it is easier simply to find the required function and 
verify directly that it solves the problem posed than to justify and overcome all the 
technical difficulties that arise along the way. As it happens, generalized functions, 
which have already been mentioned, play an essential role in the theoretical struggle 
with these difficulties. 

Thus, regarding ¢ as a parameter, we carry out a Fourier transform on x on both 
sides of the equation. Then, assuming on the one hand that differentiation with 
respect to the parameter under the integral sign is permitted and using formula 
(18.105) on the other hand, we obtain 


i, (,t) = —a°87H(E, 1), 
from which we find 
fi(E,t) = AE) cosaét + B(E) sinaét. 
By the initial conditions, we have 
ai(é,0) = f(&) = AG), 
ui (&,0) = (w))(, 0) = 8G) = af BEE). 
Thus, 


a(é,t) = f(E)cosaét + 6 sinagt = 
a 


1} F = 1 8(&) F = 
A. iaét iaét = ia&t _ ,—iaét 
=5fE (e+e YF 5 aa (ef@6t — iat) 
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Multiplying this equality by ame *§ and integrating with respect to € — in short, 
taking the inverse Fourier transform — and using formula (18.105) we obtain imme- 
diately 


1 iy 
u(x,t) = 5(f@ — at) +f +at)) + 5 (g(x — at) + g(x +ar)) dr. 


b. The Heat Equation 


Another element of the machinery of Fourier transforms (specifically, formulas 
(18.114’) and (18.115’)) which remained in the background in the preceding ex- 
ample, manifests itself quite clearly when we seek a function u = u(x,t), x € R”, 
t > 0, that satisfies the heat equation 


a 
= =a’Au (a>0) 


and the initial condition u(x, 0) = f(x) on all of R”. 
a2 
axe . 
Carrying out a Fourier transform with respect to the variable x € R”, (assuming 
that this is possible to do) we find by (18.105) the ordinary equation 


Here, as always A = 6 feet 
1 


Ou . A 
a7 ED =e (EH + EAE, 
from which it follows that 
a(é,t) = c(é)e~" BI, 


where |&|? = Ee +---+&?. Taking into account the relation a(&, 0) = ff), we find 


fi(é,t) = fe) ee 8", 


Now applying the inverse Fourier transform, taking account of (18.114’), we 
obtain 


u(x,t) = (2n)"? i FO) Eo —x,t)dy, 


: ; : : . 2612 
where E(x, ft) is the function whose Fourier transform with respect to x is e~% Lita 


The inverse Fourier transform with respect to € of the function EW EP ig essentially 
already known to us from Example 10. Making an obvious change of variable, we 
find 


Eo(x,t)= 


1 Jt n _ bee 
aen(r) —_ 
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Setting E(x, t) = (21)~"/* Eo(x, t), we find the fundamental solution 


Ix! 


E(x,t)=(2aJ/nt)"e 4% (t>0), 


of the heat equation, which was already familiar to us (see Example 15 of 
Sect. 17.4), and the formula 


u(x, th=(f * E)(x,t) 


for the solution satisfying the initial condition u(x, 0) = f(x). 


c. The Poisson Summation Formula 


This is the name given to the following relation 


[e,e) 


V2x Y° gQnn)= D> Gn) (18.116) 


n=—OoO n=—CO 


between a function g : R — C (assume g € S) and its Fourier transform @. Formula 
(18.116) is obtained by setting x = 0 in the equality 


Jon a g(x +27n) = PS o(nyel”™, (18.117) 


n=—OO n=—CO 


which we shall prove assuming that ¢ is a rapidly decreasing function. 


Proof Since y and @ both belong to S, the series on both sides of (18.117) con- 
verge absolutely (and so they can be summed in any order), and uniformly with 
respect to x on the entire line IR. Moreover, since the derivatives of a rapidly de- 
creasing function are themselves in class S$, we can conclude that the function 
fx) = er 45 G(X + 2771) belongs to C‘)(R, C). The function f is obviously 
of period 27. Let {¢,(f)} be its Fourier coefficients in the orthonormal system 
{tel k € Z}, then 


2 oo 2 

af) = _ / fone dx = ms a i; " p(x + Inne dy = 
2x Jo nooo V2 JO 

oo 1 2n(n+1) 


i= 00°: 2n J2nn 


But f is a smooth 27-periodic function and so its Fourier series converges to it 
at every point x € R. Hence, at every point x € R we have the relation 


g(xje dx = o(x)je'* dx =: G(k). 


Tel 


[o,@) [o,@) i [o,@) 
ell 1 


> v@ +2) =f@= NTE Fe DL pine. 


n=—OoO n=—Oo —c 
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Remark 7 As can be seen from the proof, relations (18.116) and (18.117) by no 
means hold only for functions of class S. But if g does happen to belong to S, then 
Eq. (18.117) can be differentiated termwise with respect to x any number of times, 
yielding as a corollary new relations between g, g’,..., and @. 


d. Kotel’nikov’s Theorem (Whittaker-Shannon Sampling Theorem)~ 


This example, based like the preceding one on a beautiful combination of the Fourier 
series and the Fourier integral, has a direct relation to the theory of information 
transmission in a communication channel. To keep it from appearing artificial, we 
recall that because of the limited capabilities of our sense organs, we are able to 
perceive signals only in a certain range of frequencies. For example, the ear “hears” 
in the range from 20 Hz to 20 kHz. Thus, no matter what the signals are, we, like 
a filter (see Sect. 18.3.1) cut out only a bounded part of their spectra and perceive 
them as band-limited signals (having a bounded spectrum). 

For that reason, we shall assume from the outset that the transmitted or received 
signal f(t) (where f is time, —oo < t < oo) is band-limited, the spectrum being 
nonzero only for frequencies whose magnitudes do not exceed a certain critical 
value a > 0. Thus f (w) = 0 for |w| > a, and so for a band-limited function the 
representation 


7O= = [ - flo)el dw 


reduces to the integral over just the interval [—a, a]: 


fO= = 7 fla) da. (18.118) 


On the closed interval [—a, a] we expand the function f (w) in a Fourier series 


[ee 


fo) = ee(fel* (18.119) 


—oo 


in the system {ela k, k € Z} which is orthogonal and complete in that interval. Tak- 
ing account of formula (18.118), we find the following simple expression for the 
coefficients cx, (f) of this series: 


ass f fe ta* do a=" 7 K), (18.120) 
2a J_a 2a a 


?5V.A. Kotel’nikov (b. 1908) — Soviet scholar, a well-known specialist in the theory of radio 
communication. 

J.M. Whittaker (1905-1984) — British mathematician who worked mainly in complex analysis. 
C.E. Shannon (1916-2001) — American mathematician and engineer, one of the founders of 
information theory and inventor of the term “bit” as an abbreviation of “binary digit’. 
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Substituting the series (18.119) into the integral (18.118), taking account of rela- 


tions (18.120), we find 
f= = "(= py, *(= ke iw@t— be) da = 


[o,@) 
ab SF A(T) feet a 
2a hae a 7 ; 


Calculating these elementary integrals, we arrive at Kotel’nikov’s formula 


ca m_\ sina(t — =k) 
7G= > #(=4) =n (18.121) 


k=—oo 


Formula (18.121) shows that, in order to reconstruct a message described by a 
band-limited function f(t) whose spectrum is concentrated in the frequency range 
|@| <a, it suffices to transmit over the channel only the values f(kA) (called 
marker values) of the function at equal time intervals A = zr/a. 

This proposition, together with formula (18.121) is due to V.A. Kotel’nikov and 
is called Kotel’nikov’s theorem or the sampling theorem. 


Remark 8 The interpolation formula (18.121) itself was known in mathematics be- 
fore Kotel’nikov’s 1933 paper, but this paper was the first to point out the fundamen- 
tal significance of the expansion (18.121) for the theory of transmission of continu- 
ous messages over a communication channel. The idea of the derivation of formula 
(18.121) given above is also due to Kotel’nikov. In the general case this question 
was later studied by the outstanding American engineer and mathematician Claude 
Shannon, whose work in 1948 provided the fundamentals the information theory. 


Remark 9 In reality the transmission and receiving time of a communication is also 
limited, so that instead of the entire series (18.121) we take one of its partial sums 
ye n- Special research has been devoted to estimating the errors that thereby arise. 


Remark 10 Tf we assume that the amount of information transmitted over the com- 
munication channel is proportional to the amount of reference values, then accord- 
ingly to formula (18.121) the communication channel capacity is proportional to its 
bandwidth frequency. 


18.3.5 Problems and Exercises 


1. a) Write out the proof of relations (18.93)—(18.96) in detail. 
b) Regarding the Fourier transform as a mapping f + /f, show that it has the 
following frequently used properties: 
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1 .f@ 
f(at)i> —f{ — 
a’ \a 
(the change of scale rule); 
ft —to) > fle 
(time shift of the input signal — the Fourier pre-image — or the translation theorem) 


f(w)2 cos wto, 
f(@)2sinato; 


[f(t +%)+ ft - to) | = | 


f (Het! > f(w+a) 


(frequency shift of the Fourier transform); 


Tex x 
f(t) cos @ot b> 5Lf@- wo) + f (@ + ao)], 


Loa rn 
f(t) sin wot > sLf@ wo) — f(@ + )] 


(amplitude modulation of a harmonic signal); 
t | eae, - * 
f(t) sin? > a ql2f) — f(w— 9) - f (w+ @0)]. 


c) Find the Fourier transforms (or, as we say, the Fourier images) of the follow- 
ing functions: 


1 
5, for|t)<A, 

TI4(t) = 4 74 
0 for|t]>A 


(the rectangular pulse); 
IT, (t) cos wot 
(a harmonic signal modulated by a rectangular pulse); 
ITa(t + 2A) + IT,(t — 2A) 
(two rectangular pulses of the same polarity); 
TTa(t — A) — ITa(t + A) 
(two rectangular pulses of opposite polarity); 


1 It 

ad — 4) for |t|<A, 

Asay au 4 
0 for |t|} > A 
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(a triangular pulse); 


cosat* and sinat* (a > 0); 
al —1 —alt| 
lt] 2 and |t|2e (a>0). 


d) Find the Fourier pre-images of the following functions: 


_ @A _ sin?wA 2 @A 
sinc —, 2i , 2sinc* —, 
4 wA 4 
where sinc + := ““* is the sample function (cardinal sine). 


e) Using the preceding results, find the values of the following integrals, which 
we have already encountered: 


°° sinx © sin? x om a ar) 
— dx, 5 dx, cos x dx, sinx~ dx. 
—oo * —oo * —0o —00 


f) Verify that the Fourier integral of a function f(t) can be written in any of the 
following forms: 


fo~ f flojel"? do = i dof fae 8 R= 
a 21 J—oo = 


=-[- dof f(x) cos 2@(x — t) dx. 
JO —00 


2 
2. Let f = f(x, y) be a solution of the two-dimensional Laplace equation st + 
mf = 0 in the half-plane y > 0 satisfying the conditions f(x,0) = g(x) and 


f(x, y) > Oas y > +00 for every x ER. 


a) Verify that the Fourier transform fi (€, y) of f on the variable x has the form 
a(E)e I, 

b) Find the Fourier pre-image of the function e~'*! on the variable é. 

c) Now obtain the representation of the function f as a Poisson integral 


ae y 
fon y= sf Gop Oe. 


which we have met in Example 5 of Sect. 17.4. 


3. We recall that the nth moment of the function f : R > C is the quantity M,(f) = 
i x” f (x) dx. In particular, if f is the density of a probability distribution, that is, 
f(x) => 0 and ines f(x) dx = 1, then x9 = Mj(f) is the mathematical expectation 
of a random variable x with the distribution f and the variance oes ee (x — 
x0)? f (x) dx of this random variable can be represented as o= M2(f) - Me (f). 
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Consider the Fourier transform 
aA oo . 
f@)= | foe dk 
—0o 


of the function f. By expanding e~‘** in a series, show that 


a) f() = CO" MoD) gn if, for example, f € S. 

b) Mn(f) =)" FO), n=O, 1,0... 

c) Now let f be real-valued, and let f(€) = A(E)el?), where A(é) is the ab- 
solute value of f(&) and g(&) is its argument; then A(é) = A(—é) and g(—é) = 
—g(&). To normalize the problem, assume that i sae Ff (x) dx = 1. Verify that in that 
case 


A’(0) — YOY 


fE)=1t+ig’ OE + : 


E> +0(&) (€>0) 
and 
xo:= Mi(f)=—¢'(0), and 0? = M2(f) — M?(f) =—A"(0). 


4. a) Verify that the function e~“!*! (a > 0), like all its derivatives, which are de- 
fined for x ¢ 0, decreases at infinity faster than any negative power of |x| and yet 
this function does not belong to the class S. 

b) Verify that the Fourier transform of this function is infinitely differentiable on 
R, but does not belong to S (and all because e~@'*! is not differentiable at x = 0). 


5. a) Show that the functions of class S are dense in the space 72(R”,C) of 
functions f : R’ + C whose squares are absolutely integrable, endowed with 
the inner product (f,g) = Jie (f - g)(x)dx and the norm it generates || f|| = 
(fran | f |? (x) dx)!/? and the metric d(f, g) = || f — gil. 

b) Now let us regard S as a metric space (S,d) with this metric d (convergence 
in the mean-square sense on R”). Let L2(R”, C) or, more briefly, Lz, denote the 
completion of the metric space (S,d) (see Sect. 9.5). Each element f € L2 is de- 
termined by a sequence {gx} of functions yg € S that is a Cauchy sequence in the 
sense of the metric d. 

Show that in that case the sequence {@} of Fourier images of the functions @,% is 
also a Cauchy sequence in S' and hence defines a certain element 7 € L2, which it 
is natural to call the Fourier transform of f € Lo. 

c) Show that a vector-space structure and an inner product can be introduced in 
a natural way on L3, and in these structures the Fourier transform L2—> L> turns out 
to be a linear isometry of L2 onto itself. 

d) Using the example of the function f(x) = Ts one can see that if f € 

x 


R2(R, C) we do not necessarily have f € R(R, C). Nevertheless, if f € R2(R, C), 
then, since f is locally integrable, one can consider the function 


x 1 A : 
= — “EX dy 
fa) i, f(xje x 
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Verify that fa fe C(R, C) and fa E Ro(R, C). 
e) Prove that a converges in Lz to some element 7 € Lz and || fall > fll = 
\| f || as A — +00 (this is Plancherel’s theorem?°), 


6. The uncertainty principle. Let g(x) and w(p) be functions of class S (or 

elements of the space Lz of Problem 5), with yw = @ and oe lp|?(x) dx = 
2 2 

ieee |v |?(p) dp = 1. In this case the functions |g|* and |y|? can be regarded as 

probability densities for random variables x and p respectively. 


a) Show that by a shift in the argument of @ (a special choice of the point 
from which the argument is measured) one can obtain a new function @ such that 
Mi (Ig|) = f°, xlg/? (x) dx = 0 without changing the value of |||, and then, with- 
out changing the relation Mj (||) = 0 one can, by a similar shift in the argument of 
w arrange that My (\y|) = f°3, plwl?(p) dp =0. 

b) For real values of the parameter a consider the quantity 


CO 
/ laxp(x) + y'(x)| dx > 0 
—0oo 


and, using Parseval’s equality and the formula @/(p) = ip@(p), show that 
a> M>(\p|) — a + Mo(\y|) = 0. (For the definitions of M, and M2 see Problem 3.) 
c) Obtain from this the relation 


Mp(Ig|) -Mo(Iwl) = 1/4. 


This relation shows that the more “concentrated” the function @ itself is, the 
more “smeared” its Fourier transform, and vice versa (see Examples | and 7 and 
Problem 7b). 

In quantum mechanics this relation, called the uncertainty principle, assumes 
a specific physical meaning. For example, it is impossible to measure precisely 
both the coordinate of a quantum particle and its momentum. This fundamental 
fact (called Heisenberg’s”’ uncertainty principle), is mathematically the same as 
the relation between M2(|g|) and M2(|w|) found above. 

The next three problems give an elementary picture of the Fourier transform of 
generalized functions. 


7. a) Using Example 1, find the spectrum of the signal expressed by the functions 
I 


Aq(t) =} 2 
alt) 0 for |t| >a. 


for |t| <a, 


b) Examine the variation of the function A,(t) and its spectrum as a > +0 
and tell what, in your opinion, should be regarded as the spectrum of a unit pulse, 
expressed by the 6-function. 


26M. Plancherel (1885-1967) — Swiss mathematician. 
27W. Heisenberg (1901-1976) — German physicist, one of the founders of quantum mechanics. 
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c) Using Example 2, now find the signal g(t) emerging from an ideal low- 
frequency filter (with upper frequency limit a) in response to a unit pulse d(t). 

d) Using the result just obtained, now explain the physical meaning of the terms 
in the Kotel’nikov series (18.121) and propose a theoretical scheme for transmitting 
a band-limited signal f(t), based on Kotel’nikov’s formula (18.121). 


8. The space of L. Schwartz. Verify that 


a) If g € S and P is a polynomial, then (P-g) €S. 

b) Ifg eS, then D“y € S and D#(P D%q) € S, where w and f are nonnegative 
multi-indices and P is a polynomial. 

c) We introduce the following notion of convergence in S. A sequence {gx} of 
functions g;, € S converges to zero if for all nonnegative multi-indices a and f the 
sequence of functions {x8 D“ y(x)} converges uniformly to zero on R”. The relation 
gv > o € S will mean that (g — gg) > Oin S. 

The vector space S' of rapidly decreasing functions with this convergence is 
called the Schwartz space. 

Show that if g, — g in S, then gj — @ in S as k — oo. Thus the Fourier trans- 
form is a continuous linear operator on the Schwartz space. 


9. The space S' of tempered distributions. The continuous linear functionals defined 
on the space S of rapidly decreasing functions are called tempered distributions. The 
vector space of such functionals (the conjugate of S) is denoted S’. The value of the 
functional F € S’ on a function g € S will be denoted F(¢g). 


a) Let P:R” > C be a polynomial in n variables and f : R” > C a locally 
integrable function admitting the estimate | f(x)| < |P(x)| at infinity (that is, it may 
increase as x —> oo, but only moderately: not faster than power growth). Show that 
f can then be regarded as a (regular) element of S’ if we set 


f= | F(x)p(x)dx (ge). 


b) Multiplication of a tempered distribution F € S’ by an ordinary function f : 
R” — C is defined, as always, by the relation (f F)(~) := F (fq). Verify that for 
tempered distributions multiplication is well defined, not only by functions f € S, 
but also by polynomials P : IR” > C. 

c) Differentiation of tempered distributions F € S’ is defined in the traditional 
way: (D“F)(g) := (—1)*! F(D%@). 

Show that this is correctly defined, that is, if F € S’, then D° F € S’ for every 
nonnegative integer multi-index a = (q@1,..., Qn). 

d) If f and ¢ are sufficiently regular functions (for example, functions in S), 
then, as relation (18.113) shows, the following equality holds: 


f@)= [ Fe) dx = A FOG) dx = FG). 
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This equality (Parseval’s equality) is made the basis of the definition of the 
Fourier transform F of a tempered distribution F € S’. By definition we set 
F(g):= F@). 

Due to the invariance of S under the Fourier transform, this definition is correct 
for every element F € S’. 

Show that it is not correct for generalized functions in D’(R”) mapping the space 
D(R") of smooth functions of compact support. This fact explains the role of the 
Schwartz space S in the theory of the Fourier transform and its application to gen- 
eralized functions. 

e) In Problem 7 we acquired a preliminary idea of the Fourier transform of the 
6-function. The Fourier transform of the 6-function could have been sought directly 
from the definition of the Fourier transform of a regular function. In that case we 
would have found that 


bE) = / d(x)e 7 @*) dy = 
IR” 


1 
(27r)n/2 (27r)n/2 : 
Now show that when we seek the Fourier transform of the tempered distribution 
6 € S’(R") correctly, that is, atartine from the equality 5 (gv) = 6(@), the result (still 
the same) is that 6(@) = @(0) = an a2: (One can renormalize the Fourier transform 
so that this constant equals 1; see Problem 10.) 

f) Convergence in S’, as always in generalized functions, is understood in 
the following sense: (F;, > F) in S’ asn > co := (Vy € S (Fx (y~) > F(g) as 
n— oo)). 

Verify the Fourier inversion formula (the Fourier integral formula) for the 6- 
function: 


i(x,€) 
50) = tim a f af SE el) ae. 


g) Let d(x — xo), as usual, denote the shift of the 5-function to the point xo, that 
is, d(x — x9)(Y) = (x0). Verify that the series 


lee) N 
5(x — = ili - 
> (x —n) ( slim Doe ») 
n=—oOo —N 
converges in S’(IR"). (Here 5 € S’(R") and n € Z.) 
h) Using the possibility of differentiating a convergent series of generalized 
functions termwise and taking account of the equality from Problem 13f of 
Sect. 18.2, show that if F = )°°° 5(x —n), then 


n=—C 
(oe) 

F=V2n Y> 5(x—2nn). 

n=—CO 


i) Using the relation F (~) = F(@), obtain the Poisson summation formula from 
the preceding result. 
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j) Prove the following relation (the 6-formula) 


loo) : z oo 2» 
—tn —™n 
e =,/— e 7 t>0), 


n=—CO n=—Oo 


which plays an important role in the theory of elliptic functions and the theory of 
heat conduction. 


10. If the Fourier transform F[ f] ofa function f : R— C is defined by the formu- 
las 


fv) = FIf |v) =) fe 27 dt, 


many of the formulas relating to the Fourier transform become particularly simple 
and elegant. 


a) Verify that f(u) = et Ge 
b) Show that F[F[f]](®) = f (—2), that is, 


fO= / Foye" av. 


This is the most natural form of the expansion of f in harmonics of different 
frequencies v, and 7 (v) in this expansion is the frequency spectrum of f. 
c) Verify that = 1 and i =6. 
d) Verify that the Poisson summation formula (18.116) now assumes the partic- 
ularly elegant form 
CO [o,@) 


Yo v= Yo Gen). 


n=—C n=—C} 


Chapter 19 
Asymptotic Expansions 


The majority of phenomena that we have to deal with can be characterized mathe- 
matically by a certain set of numerical parameters having rather complicated inter- 
relations. However the description of a phenomenon as a rule becomes significantly 
simpler if it is known that some of these parameters or some combination of them 
is very large or, contrariwise, very small. 


Example I In describing relative motions occurring with speeds v that are much 
smaller than the speed of light (|v| < c) we may use, instead of the Lorentz trans- 
formations (Example 3 of Sect. 1.3) 


VU 
ge x—ut ge t — (5)x 


* eye /1-@)? 


the Galilean transformation 


since u/c ~ 0. 


Example 2 The period 


a ti do 
r=4/— | 
SJo  V1—Kk?sin?6 
of oscillations of a pendulum is connected with the maximal angle of deviation go 


from its equilibrium position via the parameter k* = sin? ” (see Sect. 6.4). If the 
oscillations are small, that is, g@9 + 0, we obtain the simple formula 


1 
T ¥2n./- 
& 
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for the period of such oscillations. 
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Example 3 Suppose a restoring force acting on a particle m is returning it to its equi- 
librium position and that the force is proportional to the displacement (a spring with 
spring constant k, for example). Suppose also that the resisting force of the medium 
is proportional to the square of the velocity (with coefficient of proportionality a). 
The equation of motion in that case has the following form (see Sect. 5.6): 


mx +ax* +kx =0. 


If the medium “rarefies”, then a — 0 and one may assume that the motion is 
approximated by the motion described by the equation 


mx +kx =0 


(harmonic oscillations with frequency ,/ £), and if the medium “condenses”, then 


a —> 00, and, dividing by a, we find in the limit the equation x* = 0, that is, x(t) = 
const. 


Example 4 If 2(x) is the number of primes not larger than x € R, then, as is known 
(see Sect. 3.2), for large x the quantity (x) can be found with small relative error 
by the formula 


es 
u(x) ¥ —. 


Example 5 It would be difficult to find more trivial, yet nevertheless important re- 
lations than 


sinx ¥x or In(l+x)*x, 


in which the relative error becomes smaller as x approaches 0 (see Sect. 5.3). These 
relations can be made more precise if desired, namely 


. 1 3 1 2 
sinx ¥x—-—x", Indi +x)*x-— =x", 


3! 2 


by adjoining one or more of the following terms obtained from the Taylor series. 


Thus the problem is to find a clear, convenient, and essentially correct description 
of a phenomenon being studied using the specifics of the situation that arises when 
some parameter (or combination of parameters) that characterizes the phenomenon 
is small (tends to zero) or, contrariwise, large (tends to infinity). 

Hence, we are once again essentially discussing the theory of limits. 

Problems of this type are called asymptotic problems. They arise, as one can see, 
in practically all areas of mathematics and natural science. 

The solution of an asymptotic problem usually consists of the following stages: 
passing to the limit and finding the (main term of the) asymptotics, that is, a conve- 
nient simplified description of the phenomenon; estimating the error that arises in 
using the asymptotic formula so found, and determining its range of applicability; 


19.1 Asymptotic Formulas and Asymptotic Series 589 


then sharpening the main term of the asymptotics, analogous to the process of ad- 
joining the next term in Taylor’s formula (but far from being equally algorithmic in 
every case). 

The methods of solving asymptotic problems (called asymptotic methods) are 
usually closely connected with the specifics of a problem. Among the few rather 
general and at the same time elementary asymptotic methods one finds Taylor’s 
formula, one of the most important relations in differential calculus. 

The present chapter should give the reader a beginning picture of the elementary 
asymptotic methods of analysis. 

In the first section we shall introduce the general concepts and definitions relating 
to elementary asymptotic methods; in the second we shall use them in discussing 
Laplace’s method of constructing the asymptotic expansion of Laplace transforms. 
This method, which was discovered by Laplace in his research on the limit theo- 
rems of probability theory, is an important component of the saddle-point method 
later developed by Riemann, usually discussed in a course of complex analysis. 
Further information on various asymptotic methods of analysis can be found in the 
specialized books cited in the bibliography. These books also contain an extensive 
bibliography on this circle of questions. 


19.1 Asymptotic Formulas and Asymptotic Series 


19.1.1 Basic Definitions 


a. Asymptotic Estimates and Asymptotic Equalities 
For the sake of completeness we begin with some recollections and clarifications. 


Definition 1 Let f : X — Y and g: X — Y be real- or complex- or in general 
vector-valued functions defined on a set X and let B be a base in X. Then the 
relations 


f=O(g) or fx)=O(g(x)) xeXx 
f=O(g) or f(x)=O(g(x)) over the base B 
f=o(g) or f(x)=o(g(x)) _ over the base B 
mean by definition that in the equality | f(x)| = a(x)|g(x)|, the real-valued func- 


tion a(x) is respectively bounded on X, ultimately bounded over the base B, and 
infinitesimal over the base B. 


These relations are usually called asymptotic estimates (of f). 
The relation 


f~g or f(x)~ g(x) over the base B, 
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which by definition means that f(x) = g(x) + o(g(x)) over the base B, is usu- 
ally called asymptotic equivalence or asymptotic equality! of the functions over the 
base B. 

Asymptotic estimates and asymptotic equalities unite in the term asymptotic for- 
mulas. 

Wherever it is not important to indicate the argument of a function the abbrevi- 
ated notations f = o(g), f = O(g), or f ~ g are used, and we shall make system- 
atic use of this abbreviation. 

If f = O(g) and simultaneously g = O(f), we write f = g and say that f and 
g are quantities of the same order over the given base. 

In what we are going to be doing below, Y =C or Y=R, X CCor X CR; B 
as arule is one of the bases X 5 x — 0 or X 5 x > ow. Using this notation one can 
write in particular that 


cosx=O(1), xeER, 
cosz#O(1), zéEC, 
Ine’ =1+2z+0(z) asz—>0, zEC, 


(1+x)*=1l+ax+o(x) asx—>0, xER, 


(x)= m+) asx —-+oo, xER. 
Inx Inx 

Remark I In regard to asymptotic equalities it is useful to note that they are only 
limiting relations whose use is permitted for computational purposes, but only after 
some additional work is done to find an estimate of the remainder. We have already 
mentioned this when discussing Taylor’s formula. In addition, one must keep in 
mind that asymptotic equivalence in general makes it possible to compute with small 
relative error, but not small absolute error. Thus, for example, as x — +00, the 
difference (x) — 7 does not tend to zero, since 1(x) jumps by | at each prime 
integer value of x. At the same time, the relative error in replacing (x) by 77> tends 
to zero: 


ogy) 
(ay) 


>0O asx—>-+0. 


This circumstance, as we shall see below, leads to asymptotic series that have 
computational importance when one considers the relative error but not the abso- 
lute error; for that reason these series are often divergent, in contrast to classical 
series, for which the absolute value of the difference between the function being 
approximated and the mth partial sum of the series tends to zero as n > +00. 

Let us consider some examples of ways of obtaining asymptotic formulas. 


'It is also useful to keep in mind the symbol ~ often used to denote asymptotic equivalence. 
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Example 6 The labor involved in computing the values of n! or Inn! increase as 
n € N increases. We shall use the fact that n is large, however, and obtain under that 


assumption a convenient asymptotic formula for computing Inn! approximately. 
It follows from the obvious relations 


n I k iG n k+1 n+l 
/ Invdv= > f Inxdx < Drink <> [ Inxax = f Inx dx 
1 kan? kl k=l kare k 2 


that 


n 2 n+1 
0<innt— f Inxdx < f inxax + f Inx dx <In2(n +1). 
1 1 n 


But 
n 
i, Inx dx =n(Inn — 1) +1=nInn—(n—-1), 
1 
and therefore as n > co 
n 
Inn! = i: Inx dx + O(In2(n + 1)) = 
1 
=ninn—(n—1)4+ Odnn)=nInn+ O(n). 


Since O(n) = o(n Inn) when n — +00, the relative error of the formula Inn! ~ 
nInn tends to zero as n > +00. 


Example 7 We shall show that as x — +00 the function 


x ef 
ie = f dt (neR) 
1 


is asymptotically equivalent to the function g,(x) = x~” 


x — +00, applying L’HO6pital’s rule we find 
fn (x) ee Co eer x "et 
— = lm = lim 


X>+00 By (x) ~ x>-+00 gy (x) ~~ x00 xNeX — nx ler 


e*. Since g,(x) — +00 as 


=1. 


Example § Let us find the asymptotic behavior of the function 


xX oft 


e 
rays f Sar 
1 ¢ 


more precisely. It differs from the exponential integral 
x el 
Ei(x) = / —dt 
eee: 


only by a constant term. 
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Integrating by parts, we obtain 
x x ef e! e! ’ 
+ Fags Gore) 
ee’ Net \ |* * Ble! 
= (S + 7 + =) +f = dt = 
t ¢ PA aie F 
oO! i! 2! (n—1)\|* * nile! 
—p{f — a ES ag 
=e(F+a+at + ro yi +f ae 


This last integral, as shown in Example 7, is O(x~*e*) as x > +oo. Includ- 
ing in the term O(x~*e*) the constant —e y= (k — 1)! obtained when t = 1 is 
substituted, we find that 


f@et 


n 


k—1)! e 
foyse S$ = +0(=) as x > +00. 


k=1 


The error O(=>) in the approximate equality 


n 


k—1)! 
foxy Soe 


k=1 


is asymptotically infinitesimal compared with each term of the sum, including the 
last. As the same time, as x — +00 each successive term of the sum is infinitesimal 
compared with its predecessor; therefore it is natural to write the continually sharper 
sequence of such formulas as a series generated by f: 


xt (k=! 
f(x)xe Da ge 


We note that this series obviously diverges for every value of x € R, so that we 
cannot write 


ok — 1! 
fase So 


k=1 


Thus we are dealing here with a new and clearly useful asymptotic interpre- 
tation of a series connected, in contrast with the classical case, with the relative 
rather than the absolute error of approximation of the function. The partial sums of 
such a series, in contrast to the classical case, are used not so much to approximate 
the values of the function at specific points as to describe their collective behav- 
ior under the limiting passage in question (which in the present example occurs as 
x — +00). 
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b. Asymptotic Sequences and Asymptotic Series 


Definition 2 A sequence of asymptotic formulas 


f (x) = Wo(x) + o(Wolx)), 
f(x) = Wo) + Wie) +:0(¥1@)), 


Ff (x) = Wo) + Wie) +--+ + Vinx) + 0(¥n@)), 


that are valid over a base 6 in the set X where the functions are defined, is written 
as the relation 


F(x) = Yo(X) + Wi) +++ + Yn) +: 


or, more briefly, as f (x) ~ 72.9 We (x). It is called an asymptotic expansion of f in 
the given base B. 
It is clear from this definition that in asymptotic expansions we always have 


o(Wn(x)) = Wn41(%) + 0(Wn41()) over the base B, 
and hence for any n = 0,1, 2,... we have 
Wnti(x) = (Wn (x)) over the base 6, 


that is, each successive term of the expansion contributes its correction, which is 
asymptotically more precise in comparison with its predecessor. 
Asymptotic expansions usually arise in the form of a linear combination 


CoPo(X) + C191 (X) +++ + Cy Gn(X) + °° > 


of functions of some sequence {@,(x)} that is convenient for the specific problem. 


Definition 3 Let X be a set with a base 6 defined on it. The sequence {g,(x)} 
of functions defined on X is called an asymptotic sequence over the base B if 
QYn+1(x) = 0(Y~,(x)) over the base B (for any two adjacent terms ¢, and ¢,+1 of 
the sequence) and if none of the functions @, € {@,(x)} is identically zero on any 
element of B. 


Remark 2 The condition that (g,|g)(x) # 0 on the elements B of the base BG is 
natural, since otherwise all the functions @p+1, @n+2,... would also be zero on B 


and the system {g,} would be trivial in respect to its asymptotics. 


Example 9 The following sequences are obviously asymptotic: 
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a) 1,x,x2,...,x",...asx > 0; 

1 1 1 . 
b) 1, es sooo es Gry ++ ASX > OO; 
c) xPl,xP2,..., xP"... 


in the base x > Oif pi < po <---< pn <--:, 
in the base x > oo if py > por >--: > Pa >-'5 
d) the sequence {g(x)@,(x)} obtained from an asymptotic sequence through 
multiplication of all its terms by the same function. 


Definition 4 If {¢,} is an asymptotic sequence over the base B, then an asymptotic 
expansion of the form 


f (Xx) X cogo(x) + e1gi (x) +++: + en G@n(x) +--- 


is called an asymptotic expansion or asymptotic series of the function f with respect 
to the asymptotic sequence {y~,} over the base B. 


Remark 3 The concept of an asymptotic series (in the context of power series) was 
stated by Poincaré (1886), who made vigorous use of asymptotic expansions in his 
work on celestial mechanics. But asymptotic series themselves, like some of the 
methods of obtaining them, had been encountered earlier. In regard to the possible 
generalization of the concept of an asymptotic expansion in the sense of Poincaré 
(which we have discussed in Definitions 2-4) see Problem 5 at the end of this sec- 
tion. 


19.1.2. General Facts About Asymptotic Series 


a. Uniqueness of an Asymptotic Expansion 


When we speak of the asymptotic behavior of a function over a base B, we are 
interested only in the nature of the limiting behavior of the function, so that if two 
generally different functions f and g are equal on some element of the base B, they 
have the same asymptotic behavior over B and should be considered equal in the 
asymptotic sense. 

Moreover, if we fix in advance some asymptotic sequence {g,} in terms of which 
it is desirable to carry out an asymptotic expansion, we must reckon with the lim- 
ited possibilities of any such system of functions {g,}. To be specific, there will be 
functions that are infinitesimal with respect to every term ¢, of the given asymptotic 
system. 


Example 10 Let g(x) = 2 ,n =0, 1,...; then e* = 0(gn(x)) as x > +00. 


For that reason it is natural to adopt the following definitions. 


19.1 Asymptotic Formulas and Asymptotic Series 595 


Definition 5 If {y,,(x)} is an asymptotic sequence over the base B, a function f 
such that f(x) = 0(g@,(x)) over B for each n = 0, 1, ... is called an asymptotic zero 
with respect to {@y(x)}. 


Definition 6 Functions f and g are asymptotically equal over the base B with re- 
spect to a sequence of functions {y,} that is asymptotic over B if the difference 
f — g is an asymptotic zero with respect to {@y}. 


Proposition 1 (Uniqueness of an asymptotic expansion) Let {@,} be an asymptotic 
sequence of functions over a base B. 


a) If a function f admits an asymptotic expansion with respect to the sequence 
{@n} over B, then that expansion is unique. 

b) Ifthe functions f and g admit an asymptotic expansion in the system {Qn}, then 
these expansions are the same if and only if the functions f and g are asymptotically 
equal over B with respect to {@}. 


Proof a) Suppose the function ¢ is not identically zero on any element of B. 

We shall show that if f(x) = o(y(x)) over B, and at the same time f(x) = 
cy(x) + o(g(x)) over BL, then c = 0. 

Indeed, | f(x)| = |cg(x)| — lo(g(x))| = Iel|g@)| — o(lg@)|) over B, and so if 
|c| > 0, there exists B, € B at each point of which | f (x)| > lo (x)|, Butif f(x) = 
o(y(x)) over B, then there exists Bz € B at each point of which | f(x)| < id |p(x)|. 


Hence at each point x € Bj M By we would have to have I ig(x)| < Vo()| or, 
assuming |c| 4 0, 3|g@(x)| < 2|g(x)|. But this is impossible if g(x) 4 0 at even one 
point of B, M Bo. 

Now let us consider the asymptotic expansion of a function f with respect to the 
sequence {@,}. 

Let f (x) = cogo(x) + 0(go(x)) and f (x) = Cop(x) + 0(go(x)) over B. Subtract- 
ing the second equality from the first, we find that 0 = (co — Co) ~o(x) + 0(@o(x)) 
over B. But 0 = 0(go(x)) over B and so, by what has been proved, co — Co = 0. 

If we have proved that cp = Co, ..., Cn—1 = Cn— for two expansions of the func- 
tion f in the system {g,}, then by the equalities 


F(X) = copo(x) + +++ + Cn—=1Pn—1X) + Cn Gn (x) + O(Gn(x)), 
F(X) = cogo(x) +++ Cn-1¢n-1@) + SaGn(x) + 0(On2)) 


we find in the same way that cy, = Cy. 

By induction we now conclude that a) is true. 

b) If f(x) = cogo(®) + +++ + Cn Gn (x) + O(Gn(x)) and g(x) = copo(x) +--+ + 
Cn@n(x) + O(@n(x)) over B, then f(x) — g(x) = o(g@,(x)) over B for each n = 
0, 1,..., and hence the functions f and g are asymptotically equal with respect to 
the sequence {¢, (x) }. 

The converse follows from a), since an asymptotic zero, which we take to be the 
difference f — g, can have only the zero asymptotic expansion. 
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Remark 4 We have discussed the question of uniqueness of an asymptotic expan- 
sion. We emphasize, however, that an asymptotic expansion of a function with re- 
spect to a preassigned asymptotic sequence is by no means always possible. Two 
functions f and g in general need not always be connected by one of the asymp- 
totic relations f = O(g), f =o0(g) or f ~ g overa base B. 


The very general asymptotic Taylor formula, for example, exhibits a specific 
class of functions (having derivatives of order up to n at x = 0), each of which 
admits the asymptotic representation 


FO) = FOF FF Ox+ + [FMOx" $o(2") 
as x — 0. But even the function x!/? cannot be expanded asymptotically in the sys- 
tem 1, x, x*,.... Thus one must not identify an asymptotic sequence and an asymp- 
totic expansion with any canonical base and the expansion of any asymptotic in it. 
There are many more possible types of asymptotic behavior than can be described 
by any fixed asymptotic sequence, so that the description of the asymptotic behav- 
ior of a function is not so much an expansion in terms of a preassigned asymptotic 
system as it is the search for such a system. One cannot, for example, when com- 
puting the indefinite integral of an elementary function, require in advance that the 
result be a composition of certain elementary functions, because it may not be an 
elementary function at all. The search for asymptotic formulas, like the computation 
of indefinite integrals, is of interest only to the extent that the result is simpler and 
more accessible to investigation than the original expression. 


b. Admissible Operations with Asymptotic Formulas 


The elementary arithmetic properties of the symbols o and O (such properties as 
0(g) + o(g) = 0(g), 0(g) + O(g) = O(g) + O(g) = O(g), and the like) have been 
studied along with the theory of limits (Proposition 4 of Sect. 3.2). The following 
obvious proposition follows from these properties and the definition of an asymp- 
totic expansion. 


Proposition 2 (Linearity of asymptotic expansions) [f the functions f and g admit 
asymptotic expansions f ~ Y-~-.9dnGn and g ~~ ybngn with respect to the 
asymptotic sequence {~y} over the base B, then a linear combination of them af + 
Bg admits such an expansion, and (af + Bg) ~~ 9(@an + Bbn) Gn. 


Further properties of asymptotic expansions and asymptotic formulas in general 
will involve more and more specialized cases. 


Proposition 3 (Integration of asymptotic equalities) Let f be a continuous function 
on the interval I = [a, | (or I=], a). 
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a) If the function g(x) is continuous and nonnegative on I and the integral 
(2) . . 
Af a &(x) dx diverges, then the relations 


f(x) = O(g(~)), f(x) =0(g(~)), f@)~g@) aslax>o 
imply respectively that 
F(x)= O(G(x)), F(x) = o(G(x)), and F(x)~ G(x), 


where 
x 


ro= [fend and Gay | g(t) dt. 


b) If the functions @y(x), n =0,1,..., which are continuous and positive on 
I =[a, o[ form an asymptotic sequence as I > x — w and the integrals ®,(x) = 
i Qn (t) dt converge for x € I then the functions ®y(x),n =0,1,... also form an 
asymptotic sequence over the base 13> x > w. 

c) If the integral F(x) = f, - Ff (x) dx converges and f has the asymptotic expan- 
sion f(x) year CnGn(x) as I 3.x —> @ with respect to the asymptotic sequence 
{Qn(x)} of b), then F(x) has the asymptotic expansion F(x) = pas CrPy (x). 


Proof a) If f(x) = O(g(x)) as I 3 x > ao, there exists x9 € J and a constant M 
such that | f(x)| < Mg(x) for x € [xo, @[. It follows that for x € [xo, w[, we have 
Lg FOde| <1 foo fdt|+M fl g@) dt = Off g(t) de). 

To prove the other two relations one can use L’H6pital’s rule (as in Example 7), 
taking account of the relation G(x) = i g(t) dt > oo as 3x —> oo. As a result, 
we find 

F(x) _, ts) _ f(x) 
= lim = lim 


faye G(x) [3x0 G'(x) ~ [3x0 g(x) : 


b) Since @, (x) — OasT1 3x —> w(n=0, 1,...) applying L’ H6pital’s rule again, 
we find that 


Pn+i(x) . Dri) li Pnti(x) 
Isx>w @,(x) [3x0 PD! (x) [3x30 Qn(X) 7 


c) The function r, (x) in the relation 
f(x) = cogo(x) + C191 (%) +++ + Cn Gn (®) +n (X), 


being the difference of continuous functions on /, is itself continuous on J, and we 
obviously have R,(x) = fe rn(t)dt > 0 as 13> x > @. But rp(x) = 0(@n(X)) as 
I3x—->o and @,(x) — 0 as 13x > a. Therefore, again by L’H6pital’s rule, it 


follows that in the equality 


F(x) = co@o(x) + €1®1(X) +--+ + en On (x) + Ra (x) 


the quantity R,(x) is o(@y(x)) as TS x > @. 
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Remark 5 Differentiation of asymptotic equalities and asymptotic series is gener- 
ally not legitimate. 


Example 11 The function f(x) = e™ sin(e*) is continuously differentiable on R 
and is an asymptotic zero with respect to the asymptotic sequence {5} as x — +00. 


The derivatives of the functions a. up to a constant factor, again have the form 


+. However the function f’(x) = —e* sin(e*) + cos(e*) not only fails to be an 
asymptotic zero; it doesn’t even have an asymptotic expansion with respect to the 
sequence {=r} as x > +00. 


19.1.3 Asymptotic Power Series 


In conclusion, let us examine asymptotic power series in some detail, since they are 
encountered relatively often, although in a rather generalized form, as was the case 
in Example 8. 

We shall study expansions with respect to the sequence {x”;n = 0, 1, ...}, which 
is asymptotic as x — O and with respect to {<r n=0,1,...}, which is asymptotic as 
x —> oo. Since these are both the same object up to the change of variable x = i, we 
state the next proposition only for expansions with respect to the first sequence and 
then note the specifics of certain of the formulations given in the case of expansions 
with respect to the second sequence. 


Proposition 4 Let 0 be a limit point of E and let 


f(x) Xap tax tanx?+---, 
asE3x— 0. 
g(x) X bo + bix + box? ++: 


Thenas E> x —> 0, 


a) (af + Bg) = Vo (ean + Bbn)x": 

b) (f -g)@) = Yo gon. where Cy = agbn + atby—1 + +++ + anbo, n = 0, 
| eee 
c) if bo £0, then (£)(x) a ar dx", where the coefficients dy, can be found 
from the recurrence relations 


n 
do = bodo, aj=bod\+bido, ..., an =) > bedn—k. a 
k=0 


d) if E is a deleted neighborhood or one-sided neighborhood of 0 and f is con- 
tinuous on E, then 


x 
i: fat ~agx t+ Sy? 4. ME 
0 2 n 
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e) if in addition to the assumptions of d) we also have f € C(E) and 
f'(x) Sag taixt-., 
then aj, = (n+ l)an41,n=0,1,.... 


Proof a) This is a special case of Proposition 2. 
b) Using the properties of o() (see Proposition 4 of Sect. 3.2), we find that 


(f-g)@)= 
= f@)-s@)= 
= (a9 + ax +++ + anx” + 0(x")) (bo + Bix +++ + bnx" + 0(x")) = 
= (agbo) + (apbi + aybo)x + +++ + (aobn + atbn—1 + +++ + anbo)x" + 0(x”) 


as Eax—> 0. 

c) If bo £ 0, then g(x) £0 for x close to zero, and therefore we can consider the 
ratio a a = h(x). Let us verify that if the coefficients do, ..., dy, in the representa- 
tion h(x) = do + dix +---+d,x" +1r,(x) have been chosen in accordance with c), 
then r,(x) = o(x”) as E > x — 0. From the identity f(x) = g(x)h(x), we find that 


ag + ayx + +++ + anx" + 0(x") = 
= (bo + Dix + +++ + dnx" +.0(x")) (do + dix + +++ + dax” + ra(x)) = 
= (bodo) + (bod + bido)x ++ +++ (bodn + bidn—1 +--+ + bndo)x”" + 
+ born (x) + 0(rn(x)) + 0(x"), 


from which it follows that o(x”) = born (x) + 0(rn(x)) + 0(x”), or rn (x) = o(x") as 
E>x— 0, since bp £ 0. 

d) This follows from part c) of Proposition 3 if we set w = 0 there and recall that 
—fP fOdt= fF fede. 

e) Since the function f’(x) is continuous on ]0, x] (or [x, O[) and bounded (it 
tends to aj as x — 0), the integral ie f'(t) dt exists. Obviously f(x) = ao + 
ic f'(t) dt, since f(x) > ap as x > 0. Substituting the asymptotic expansion of 
f'(x) into this equality and using what was proved in d), we find that 


a) a. 
f(x) X ag + apx + Be ee a Ae . 
It now follows from the uniqueness of asymptotic expansions (Proposition 1) that 
al, = (n+ l)a,,n=0,1,.... 


Corollary 1 [f U is a neighborhood (or one-sided neighborhood) of infinity in R 
and the function f is continuous in U and has the asymptotic expansion 


fOeqgt 4 fd asU3x—> oO, 
x Xx x” 
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Foy= f(r -a- a) a 


over an interval contained in U converges and has the following asymptotic expan- 
sion: 


then the integral 


Fj + a3 peers an 


+: asUsx7>om. 
2x2 nx” 


Proof The convergence of the integral is obvious, since 


a, a2 
pS oa aaa as U >t > ow. 


It remains only to integrate the asymptotic expansion 


f(t) Se sas Ust 
ao a sf. asUst>o, 
t 2 3 t? 


citing, for example, Proposition 3d). 


Corollary 2 [f in addition to the hypotheses of Corollary | it is known that f € 
C(U) and f' admits the asymptotic expansion 


a’ 
fo~ay+ 4% 2 -+—+.- as U 3x —> 00, 
n 
then this expansion can be obtained by formally differentiating the expansion of the 
function f, and 


a, =—(n— 1)ap-1, n=2,3,... and a =a, =0. 
Proof Since f’(x) =ayt+4 ws O(1/x?) as U > x > o, we have 
x 
f(x) = f(x) +f f'(t) dt = agx +a) Inx + O(1) 
x0 


as U > x > oo; and since I@\Sag+ SS te and the sequence x, Inx, 1, i, 


ie . is an asymptotic sequence as U 5 x — ov, Proposition | enables us to con- 


clude that aj = a) = 0. Now, integrating the expansion f’(x) ~ S +4+---, by 
Corollary | we obtain the expansion of f(x), and by the uniqueness of the expan- 
sion we arrive at the relations a’, = —(n — 1)an_—1 forn =2,3,.... 


2 


19.1.4 Problems and Exercises 


1, a) Leth(z)= 0 ganz” for |z| > R, z€C. Show that then A(z) ~ yp anz” 
as C3az> &. 
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b) Assuming that the required solution y(x) of the equation y’(x) + y?(x) = 
sin * has an asymptotic expansion y(x) ~ °°.) cnx" as x — 00, find the first 
three terms of this expansion. 

c) Prove that if f(z) = beer Gnz" for |z| <r, z€C, and g(z) ~ byz + bz? + 

- as C3 z— 0, then the function f o g is defined in some deleted neighborhood 
of 0€ C and (f og)(z) Xcgo + cz +227 +--- as C3 z—> O, where the coeffi- 
cients cg, cj,... can be obtained by substituting the series in the series, just as for 
convergent power series. 


2. Show the following. 


a) If f is a continuous, positive, monotonic function for x > 0, then 


Yrw=f f(x)dx + O(f(n)) +O) asn— oo; 


k=0 


b) ey =Inn+c+o(1)asn>o™; 

c) De k@dnk)F ~ oe asn— oo fora > —1. 
3. Through integration by parts find the asymptotic expansions of the following 
functions as x — +00: 

a) Iy(x) = i t'—le—! dt — the incomplete gamma function; 

b) erf(x) = 5 We et dt — the probability error function (we recall that 
i ae en dr = ./m is the Euler—Poisson integral); 

c) F(x) = [7° dt ifa >0. 


x 


4. Using the result of the preceding problem, find the asymptotic expansions of the 
following functions as x —> +00: 

a) Si(x) = iy sint dt — the sine integral (we recall that is sinx dx = 4 is the 
Dirichlet integral). 

b) C(x) = Jo cos Zr? dt, S(x) = Ie sin Zt? dt — the Fresnel integrals (we recall 


that i cos x? dx = i sinx? dx = 5 /%). 


5. The following generalization of the concept of an expansion in an asymptotic 
sequence {%,(x)} introduced by Poincaré and studied above is due to Erdélyi.” 

Let X be a set, B a base in X, {gy (x)} an asymptotic sequence of functions on X. 
If the functions f(x), Wo(x), Wi (x), Wo(x), ... are such that the equality 


n 


f(x) = D> Wee) + o(Gn(x)) over the base B 


k=0 


2A. Erdélyi (1908-1977) — Hungarian/British mathematician. 
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holds for every n = 0, 1,..., we write 


f(x) >= > Vn(x), {Gn(x)} over the base B, 


n=0 


and we say that we have the asymptotic expansion of the function f over the base B 
in the sense of Erdélyi. 


a) Please note that in Problem 4 you obtained the asymptotic expansion in the 
sense of Erdélyi if you assume g(x) =x~",n=0,1,.... 

b) Show that asymptotic expansions in the sense of Erdélyi do not have the 
property of uniqueness (the functions yy, can be changed). 

c) Show that if a set X,a base 6 in X,a function f on X, and sequences {{1n(x)} 
and {g,(x)}, the second of which is asymptotic over the base B, are given, then the 
expansion 


f(x) = Yo anun(x), {Gn(x)} over the base B, 
n=0 


where a, are numerical coefficients, is either impossible or unique. 
6. Uniform asymptotic estimates. Let X be a set and By a base in X, and let f(x, y) 


and g(x, y) be (vector-valued) functions defined on X and depending on the param- 
eter y € Y. Set | f(x, y)| =a(x, y)|g(x, y)|. We say that the asymptotic relations 


f@y=o(g@,y)), fa@,y=O(ge,y)), fa,y)~s,y) 


are uniform with respect to the parameter y on the set Y if (respectively) a(x, y) 0 
on Y over the base By; a(x, y) is ultimately bounded over the base 8, uniformly 
with respect to y € Y; and finally f =a-g+o0(g), where a(x, y) = 1 on Y over 
the base Bx. 

Show that if we introduce the base 6 = {6b, x Y} in X x Y whose elements are 
the direct products of the elements B, of the base By and the set Y, then these 
definitions are equivalent respectively to the following: 


f@,y)=0(g@,y)), f@,y=O(gt.y)),  fa,y)~8,y) 
over the base B. 
7. Uniform asymptotic expansions. The asymptotic expansion 


[ee 


f(x, y) = > an (y) Gn (x) over the base Bx 
n=0 


is uniform with respect to the parameter y on Y if the estimate rp (x, y) = 0(@n(X)) 
over the base By in X holds uniformly on Y in the equalities 


n 


fy) =o aoe) +(x, y), 2 =0,1,.... 
k=0 
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a) Let Y be a (bounded) measurable set in IR”, and suppose that for each fixed 
x € X the functions f(x, y), ao(y), ai1(y),... are integrable over Y. Show that if 
the asymptotic expansion f (x, y) ~ )-°2.9 dn(y)@n(x) over the base By is uniform 
with respect to the parameter y € Y, then the following asymptotic expansion also 
holds 
[o,@) 


[tena=D(f an(o) dy on over the base By. 
y Y 


n=0 


b) Let Y = [c,d] C R. Assume that the function f(x, y) is continuously differ- 
entiable with respect to y on the closed interval Y for each fixed x € X and for some 
yo € Y admits the asymptotic expansion 


CO 


f(, yo) = Ss Gn(y0)@n(x) over the base By. 
n=0 


Prove that if the asymptotic expansion 


af = 
ay y)& Sian (y)@n(x) over the base By 
y n=0 


holds uniformly with respect to y € Y with coefficients a,(y) that are continuous 
in y,n=0,1,..., then the original function f(x, y) has an asymptotic expansion 
faye pyeeu An(y)@n(x) over the base By that is uniform with respect to y € Y, 
its coefficients a,(y), m = 0, 1,... are smooth functions of y on the interval Y and 


dan 


dy (Y) = Any). 


8. Let p(x) be a smooth function that is positive on the closed interval c <x <d. 


a) Solve the equation u(y, A)= 7 p(x)u(x, A) in the case when p(x) = 1 on 
[c, d]. 

b) Let 0 <m < p(x) < M <+o on [c,d] and let u(c, A) = 1, $4 (c,d) = 0. 
Estimate the quantity u(x, A) from above and below for x € [c, d]. 

c) Assuming that Inu(x,) ~ ieee Cn(x)Al—” as 4 — +00, where co(x), 
c1(x),... are smooth functions and, using the fact that (Hy! we ey show 


7 
that ch? (x) = p(x) and (c?_, + Dp-0 °C, @) = 0. 


19.2 The Asymptotics of Integrals (Laplace’s Method) 


19.2.1 The Idea of Laplace’s Method 


In this subsection we shall discuss Laplace’s method — one of the few reasonably 
general methods of constructing the asymptotics of an integral depending on a pa- 
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rameter. We confine our attention to integrals of the form 


b 
F(A) -| f(xy dx, (19.1) 


where S(x) is a real-valued function and A is a parameter. Such integrals are usually 
called Laplace integrals. 


Example I The Laplace transform 


+00 


LIP \E)= J — foe** dx 
0 
is a special case of a Laplace integral. 


Example 2 Laplace himself applied his method to integrals of the form 
fe Ft (x)g" (x) dx, where n € N and g(x) > 0 on Ja, b[. Such an integral is also 
a special case of a general Laplace integral (19.1), since g” (x) = exp(nIng(x)). 


We shall be interested in the asymptotics of the integral (19.1) for large values of 
the parameter A, more precisely as 1 > +00,A ER. 

So as not to become distracted with secondary issues when describing the basic 
idea of Laplace’s method, we shall assume that [a, b] = J is a finite closed interval 
in the integral (19.1), that the functions f(x) and S(x) are smooth on /, and that 
S(x) has a unique, strict maximum S(xo) at the point x9 € 7. Then the function 
exp(AS(x)) also has a strict maximum at x9, which rises higher above the other 
values of this function on the interval 7 as the value of the parameter A increases. 
As a result, if f(x) 0 in a neighborhood of xo, the entire integral (19.1) can 
be replaced by the integral over an arbitrarily small neighborhood of xo, thereby 
admitting a relative error that tends to zero as A — +00. This observation is called 
the localization principle. Reversing the historical sequence of events, one might 
say that this localization principle for Laplace integrals resembles the principal of 
local action of approximate identities and the 5-function. 

Now that the integral is being taken over only a small neighborhood of xo, the 
functions f(x) and S(x) can be replaced by the main terms of their Taylor expan- 
sions as J > x > xo. 

It remains to find the asymptotics of the resulting canonical integral, which can 
be done without any particular difficulty. 

It is in the sequential execution of these steps that the essence of Laplace’s 
method of finding the asymptotics of an integral is to be found. 


Example 3 Let xo =a, S’(a) £0, and f (a) 4 0, which happens, for example, when 
the function S(x) is monotonically decreasing on [a,b]. Under these conditions 
f(x) = f(@+o(1) and S(x) = S(a)+ (« —a)S'(a) + 0(1), as I 3 x > a. Carrying 
out the idea of Laplace’s method, for a small ¢ > 0 and 4 + +00, we find that 
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ate 
F(A) ~ / f(xjerS™ dx ~ 


fae 


é 
AS(a) AtS’(a) _ AS'(aje 
~ e e dt = ——————_(l-e . 
Fae | | ) 
Since S’(a) < 0, it follows that in the case in question 
f@eS® 
F(A)~ as h > +00. (19.2) 
AS'(a) 


Example 4 Let a < xp < b. Then S’(x9) = 0, and we assume that S” (xo) 4 0, that 
is, 5” (x0) < 0, since xo is a maximum. 

Using the expansions f(x) = f (x9) +0(x —xo) and S(x) = S(xo)+ 58" (xo) (x - 
x0)° + o((x — xo)*), which hold as x — xo, we find that for small « > 0 and 
4 —> +00 


xo+e : Ely 
F(A)~ i f(xyt3™ dx ~ Flayedseo | e2AS" (xo)? dy. 
xXQ—é 


Making the change of variable AS" (xo)t? = —u? (since S”(xg) < 0), we obtain 


” ga, ae 2 
a e245" 0) gy — 7 aol a 
—e ae a yg, oo 


where (A, 6) = fe = +oo asi > +00. 


Taking account of the equality 


+00, 
/ e du= Jn, 


—oo 


we now find the principal term of the asymptotics of the Laplace integral in this 


case: 
oC Saat a ny jf Mo ge*5@0) as A> +00. (19.3) 


Example 5 If x9 = a, but S’(x9) = 0 and S$” (x9) < 0, then, reasoning as in Exam- 
ple 4, we find this time that 


si & 1 uy 9. 
ray~ f f (eS dx ~ Flaedso | e248” ot dt, 
p 0 


Fa~5|- zi f(xpe-5° ask > +00. (19.4) 
AS!(x0) 


and so 
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We have now obtained on a heuristic level the three very useful formulas (19.2)— 
(19.4) involving the asymptotics of the Laplace integral (19.1). 

It is clear from these considerations that Laplace’s method can be used success- 
fully in the study of the asymptotics of any integral 


/ f(x,A)dx asaA— +00 (19.5) 
x 


provided (a) the localization principle holds for the integral, that is, the integral can 
be replaced by one equivalent to it as 4 — +00 extending over arbitrarily small 
neighborhoods of the distinguished points, and (b) the integrand in the localized 
integral can be replaced by a simpler one for which the asymptotics is on the one 
hand the same as that of the integral being investigated and on the other hand easy 
to find. 

If, for example, the function S(x) in the integral (19.1) has several local maxima 
X0,X1,---,X, On the closed interval [a, b], then, using the additivity of the integral, 
we replace it with small relative error by the sum of similar integrals taken over 
neighborhoods U (x;) of the maxima xo, X1,..., Xn SO Small that each contains only 
one such point. The asymptotic behavior of the integral 


i! f(x dx asa— +00, 
U(x;) 


as already mentioned, is independent of the size of the neighborhood U (x;) itself, 
and hence the asymptotic expansion of this integral as A — -+oo is denoted F(A, x;) 
and called the contribution of the point x; to the asymptotics of the integral (19.1). 

In its general formulation the localization principle thus means that the asymp- 
totic behavior of the integral (19.5) is obtained as the sum Dar F(A, x;) of the con- 
tributions of all the points of the integrand that are critical in some respect. 

For the integral (19.1) these points are the maxima of the function S(x), and, 
as one can see from formulas (19.2)-(19.4), the main contribution comes entirely 
from the local maximum points at which the absolute maximum of S(x) on [a, b] is 
attained. 

In the following subsections of this section we shall develop the general consid- 
erations stated here and then consider some useful applications of Laplace’s method. 
For many applications what we have already discussed is sufficient. It will also be 
shown below how to obtain not only the main term of the asymptotics, but also the 
entire asymptotic series. 


19.2.2. The Localization Principle for a Laplace Integral 


Lemma 1 (Exponential estimate) Let M = sup, —,—, S(x) < 00, and suppose that 
for some value Xo > 0 the integral (19.1) converges absolutely. Then it converges 
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absolutely for every } > Xo and the following estimate holds for such values of x: 
b 
|Fa)| =| [Fade*™ | dee ae, (19.6) 
a 


where AER. 


Proof Indeed, for A > Ao, 


b b 
rool =| i f@eS™ dx| = i Fe egy | 2 
a a 


b b 
aoe i | Fayel0S0)| d= (2-H , | F(aye99| a eo ; 
a a 


Lemma 2 (Estimate of the contribution of a maximum point) Suppose the in- 
tegral (19.1) converges absolutely for some value = ho, and suppose that in 
the interior or on the boundary of the interval I there is a point xo at which 
S(xo) = sup, ey <p S(X) = M. If f (x) and S(x) are continuous at xo and f (xo) £9, 
then for every € > O and every sufficiently small neighborhood U, (xo) of xo in I we 
have the estimate 


/ fe Oa Shee (19.7) 
Ur (x0) . 
with a constant B > 0, valid for X => max{Ao, O}. 


Proof Fora fixed ¢ > 0 let us take any neighborhood U; (xo) inside which | f (x)| => 
51 Ff (x0)| and S(xo) — € < S(x) < S(xo). Assuming that f is real-valued, we can 
now conclude that f is of constant sign inside U;(x). This enables us to write for 
A > max{do, 0} 


i fxr dx 
U(X) 


= / | Fx)|e*S dx > 
U7 (x0) 


1 
> / SIF a) erode = BeMSHO-, 
Ur(x0) 


Proposition 1 (Localization principle) Suppose the integral (19.1) converges abso- 
lutely for a value } = do, and suppose that inside or on the boundary of the interval 
I of integration the function S(x) has a unique point xo of absolute maximum, that 
is, outside every neighborhood U (xq) of the point xq we have 


sup S(x) < S(x0). 
I\U (xo) 


If the functions f (x) and S(x) are continuous at xo and f (xo) 4 0, then 


F(A) = Fuy()A)(L+ O(A~%)) ask +00, (19.8) 
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where U; (xo) is an arbitrary neighborhood of xo in T, 


Fu; (ayQ)°= / FxeS® dx, 
U1 (xo) 


and O(A~°) denotes a function that is 0(A~") as } > +00 for everyneéeN. 


Proof It follows from Lemma 2 that if the neighborhood U;(xo) is sufficiently 
small, then the following inequality holds ultimately as 4 — +-oo for every ¢ > 0 


| Fur) A)| > eX S09), (19.9) 


At the same time, by Lemma | for every neighborhood U (xo) of the point x9 we 
have the estimate 


/ | fx)|e*S dx < Ae*“ asa ton, (19.10) 
I\U (x0) 


where A > 0 and pe = supyey\y(x9) SCX) < S(Xo)- 
Comparing this estimate with inequality (19.9), it is easy to conclude that in- 
equality (19.9) holds ultimately as 4 —- +00 for every neighborhood U7 (xo) of xo. 
It now remains only to write 


F(A) = FLA) = Fu; A) + Fru) A); 


and, citing estimates (19.9) and (19.10), conclude that (19.8) holds. 


Thus it is now established that with a relative error of the order O(A~™) as 
2. — +00 when estimating the asymptotic behavior of the Laplace integral, one can 
replace it by the integral over an arbitrarily small neighborhood U; (xo) of the point 
xo where the absolute maximum of $(x) occurs on the interval J of integration. 


19.2.3, Canonical Integrals and Their Asymptotics 


Lemma 3 (Canonical form of the function in the neighborhood of a critical point) 
If the real-valued function S(x) has smoothness C** in a neighborhood (or one- 
sided neighborhood) of a point xy € R, and 


S'(xp) = ++» = SY) =0, Sx) 40, 


and k € N ork =o, then there exist neighborhoods (or one-sided neighborhoods) 
I, of xo and I, of 0 in R and a diffeomorphism 9 € CHU, I) such that 


S(v(y)) = S(xo) + sy", when y€ I, ands =sgn S (x9). 
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Here 


‘ n! ae 
g(O)=x9 and vO=(— | . 


Proof Using Taylor’s formula with the integral form of the remainder, 


_ n 1 
S(x) = S(xo) + (& = x0)" S™ (xo +i = xo))( = pro! dr, 
(n—I)! Jo 


we represent the difference S(x) — S(xo) in the form 
S(x) — S(xo) = (x — x0)"r(@), 


where the function 


rx)= 


1 
s™ t(x— bag de 
a =f (xo + t(x — xo))( ) 
by virtue of the theorem on differentiation of an integral with respect to the pa- 
rameter x, belongs to class C () and r(xo) = 75 (xo) + 0. Hence the function 
y= V(x) = (x — x0) V|r(x)| also belongs to C ) in some neighborhood (or one- 
sided neighborhood) J, of x9 and is even monotonic, since 


1/n 


s@ 
ir Goo) = 7 |rGo)|= (ao) # 0. 


In this case the function w on J, has an inverse y~! = ¢ defined on the interval 
Ty = W(x) containing the point 0 = w(xo). Here g € CG; Ty). 


Further, g’(0) = (W'(xo))7! = (aun) ” " Finally, by construction S(g(y)) = 


S(xo) + sy”, where s = sgnr(xo) = sgn S“ (x9). 


Remark 1 The cases n = | or n = 2 and k = 1 or k= o8 are usually the ones of 
most interest. 


Proposition 2 (Reduction) Suppose the interval of integration I = [a, b] in the in- 
tegral (19.1) is finite and the following conditions hold: 

a) f,S€CdU,R); 

b) max,¢7 S(x) is attained only at the one point xo € T; 

c) SE C™(U; (x9), R) in some neighborhood U](xo) of xo (inside the inter- 
val I); 

d) S™ (x9) £0 and if 1 <n, then S (x9) =--- = S°-) (x9) = 0. 


Then as } — +00 the integral (19.1) can be replaced by an integral of the form 


RA)= ene r(yye” dy 


y 
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with a relative error defined by the localization principle (19.8), where ly =|[—e, €] 
or Iy = [0, €], € is an arbitrarily small positive number, and the function r has the 
same degree of smoothness Iy that f has in a neighborhood of xo. 


Proof Using the localization principle, we replace the integral (19.1) with the inte- 
gral over a neighborhood J, = U; (xo) of xo in which the hypotheses of Lemma 3 
hold. Making the change of variable x = g(y), we obtain 


/ Fores ax = ( i f(e0)) 9’ (er ay 50) (19.11) 


The negative sign in the exponent (—Ay”) comes from the fact that by hypothesis 
xo = (0) is a maximum. 


The asymptotic behavior of the canonical integrals to which the Laplace integral 
(19.1) reduces in the main cases is given by the following lemma. 


Lemma 4 (Watson*) Let a > 0, 6 > 0, 0 <a < 00, and f € C({0,a], R). Then 
with respect to the asymptotics of the integral 


WA)= [ xP-! Faye dx (19.12) 
0 


as i} — +00, the following assertions hold: 


a) The main term of the asymptotics of (19.12) has the form 
1 _B _ B+1 
WA)= 5 Oe ee #+O(A- @ )s (19.13) 
if it is known that f (x) = f (0) + O(x) as > 0. 


b) Uf f(®) =a0 + aux ++++ + ayx" + O(x"*!) as x > 0, then 


ti k k+B ntB 
Wore Yar (=F) +000" ). (19.14) 
a a 
k=0 
c) If f is infinitely differentiable at x = 0, then the following asymptotic expan- 
sion holds: 


00 (k) . 
waxy t Or (SP), (19.15) 


k! 
k=0 


which can be differentiated any number of times with respect to x. 


3G.H. Watson (1886-1965) — British mathematician. 
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Proof We represent the integral (19.12) as a sum of integrals over the interval ]0, ¢] 
and [e, a[, where ¢ is an arbitrarily small positive number. 
By Lemma | 


/ 6-1 f xe dx 


é€ 


< Ae" = O(a-*°) asA— +00, 


and therefore 
é 
Wa) =f xP—! F(x)ye*™ dx + O(a) as A > +oo. 
0 


In case b) we have f (x) = Vie apx* + rp (x), where r, € C[O, €] and |r, (x)| < 
Cx"*! on the interval [0, ¢]. Hence 


n € & 
W(A)= ee af x hTBH 1 maa ay 4 a) | xt Beh dy 4 o(aA-*°), 
k=0 °° 0 


where c(A) is bounded as A — +00. 
By Lemma 1, as 4 > +00, 


€ e +00 wy 
/ xh tB-1e-Ax™ ay =f ght hl et det O(A~*). 
0 0 


But 


[- xhtB-l eax" gy = -r(* a Ba, 
0 a a 
from which formula (19.14) and the special case of it, formula (19.13), now follow. 

The expansion (19.15) now follows from (19.14) and Taylor’s formula. 

The possibility of differentiating (19.15) with respect to A follows from the fact 
that the derivative of the integral (19.12) with respect to the parameter A is an in- 
tegral of the same type as (19.12) and for W’(A) one can use formula (19.15) to 
present explicitly an asymptotic expansion as 4 —> +00 that is the same as the one 
obtained by formal differentiation of the original expansion (19.15). 


Example 6 Consider the Laplace transform 


+00 
F()= f(xje** dx, 
0 


which we have already encountered in Example |. If this integral converges abso- 
lutely for some value 4 = Ao and the function f is infinitely differentiable at x = 0, 
then by formula (19.15) we find that 


oe) 
FA)= > FP OAH) asa +00. 
k=0 
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19.2.4 The Principal Term of the Asymptotics of a Laplace Integral 


Theorem 1 (A typical principal term of the asymptotics) Suppose the interval of in- 
tegration I = [a, b] in the integral (19.1) is finite, f, Sé€ CU, R), and maxye] S(x) 
is attained only at one point xo € I. 


Suppose it is also known that f (xo) £0, f(x) = f(xo) + O(x — x0) for 1 3x > 
xo, and the function S belongs to C® in a neighborhood of xo. 
The following statements hold. 


a) Ifxo =a, k =2, and S’(xo) £0 (that is, S’(xo) < 0), then 


FA) = Ee seo +0(a7!)] as’ +00; (19.2’) 


b) ifa < x9 <b, k =3, and S" (xo) £0 (that is, S’" (x9) < 0), then 


F(A)= | Fas Stree. + o(a—'/?)] asih—> +00; (19.3’) 


c) ifxo9 =a, k =3, S'(a) =0, and S" (a) £0 (that is, S" (a) < 0), then 


a x = a / 
FQ)= Sarat oor” OAM2T1+ O(A7'7)] asd +00. (19.4’) 


Proof Using the localization principle and making the change of variable x = g(y) 
shown in Lemma 3, according to the reduction in Proposition 2, we arrive at the 
following relations: 


a) F(a) = 2800) ( i; “(fow)Q)e' (ye dy + on); 
b) F(A) =e* 50) ( A o og)(y)g"(yye*” dy + oo) = 
= e*8(%0) (fw og)(y)g'(y) + (fo y)(-y)g" (-y) eo” dy + 
+ 00>): 


c) FA) =eS0) (/ (Fo p)y' ye” dy + o@-*)). 
0 


Under the requirements stated above, the function (f 0 g)q’ satisfies all the hy- 
potheses of Watson’s lemma. It now remains only to apply Watson’s lemma (for- 
mula (19.14) for n = 0) and to recall the expressions for @(0) and g’ (0) indicated in 
Lemma 3. 


Thus we have justified formula (19.2)-(19.4) together with the remarkably sim- 
ple, clear and effective recipe that led us to these formulas in Sect. 19.1. 
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Now let us consider some examples of the application of this theorem. 

Example 7 The asymptotics of the gamma function. The function 

+00 

raA+)= / pe td GO==1) 
0 
can be represented as a Laplace integral 
+00 
rat+ l= 1 @ tet de. 
0 

and if for A > 0 we make the change of variable t = 1.x, we arrive at the integral 


+ 
rat+)p=A"! / * e-A(e—Inx) dx, 
0 


which can be studied using the methods of the theorem. 

The function S(x) = Inx — x has a unique maximum x = | on the interval 
JO, +oo[, and S”(1) = —1. By the localization principle (Proposition 1) and as- 
sertion b) of Theorem 1, we conclude that 


Xr 
rati=Vvie(=) [1+ 0(a-'7)] asa— +oo. 


In particular, recalling that [(n + 1) =n! for n € N, we obtain the classical 
Stirling’s formula* 
nl = V2rn(n/e)"[1+ O(n—'/*)] asn— oo, néeN. 
Example 8 The asymptotics of the Bessel function 


1 f* coc 
I(x) = - | e* 89 cos nd dO, 
0 


where n € N. Here f(0) = cosn6, S(O) = cos@, maxo<x<z S(O) = S(O) = 1, 
S’(0) = 0, and S$” (0) = —1, so that by assertion c) of Theorem | 


x 


[1+ O(x~'/7)] as x > +00. 
x 


I, (x) = 


Example 9 Let f €¢ C“({a, b],R), S € C®({a, b], R), with S(x) > 0 on [a, bd], 
and maxy<;<p S(x) is attained only at the one point xo € [a,b]. If f(xo) 4 9, 
S’ (xo) = 0, and S” (xo) 4 0, then, rewriting the integral 


b 
FQ)= / f(x)[S(@)]* de 


4See also Problem 10 of Sect. 7.3. 
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in the form of a Laplace integral 


b 
FQ) = i Flxje™™S® dx, 


on the basis of assertions b) and c) of Theorem 1, we find that as 4 > ++-oo 


F(A) = ef (Xo), | cin] fe) aaa a + 0(a-'/?)), 


where ¢ = lifa<xo <bande =1/2if x9 =a orx=b. 
Example 10 The asymptotics of the Legendre polynomials 
1 e n 
Pr(x)=— | (x + Vx? — 1cos6)" do 
JO 


in the domain x > 1 as n > oo, n EN, can be obtained as a special case of the 
preceding example when f = 1, 


S() =x + Vx? —1cos8, max S(0)= SO) Sx 45/x2 = 1, 
<O0<0 
S')=0,  S"O)=—-Vx? 1, 


Thus, 


et Veo 


N= J2nn/ x2 —1 


+ O(n—'/?)] asn —> +00, neN. 


19.2.5 *Asymptotic Expansions of Laplace Integrals 


Theorem | gives only the principal terms of the characteristic asymptotics of a 
Laplace integral (19.1) and even that under the condition that f(xo) 4 0. On the 
whole this is of course a typical situation, and for that reason Theorem | is un- 
doubtedly a valuable result. However, Watson’s lemma shows that the asymptotics 
of a Laplace integral can sometimes be brought to an asymptotic expansion. Such a 
possibility is especially important when f (xo) = 0 and Theorem | gives no result. 
It is naturally impossible to get rid of the hypothesis f(xo) 4 0 completely, 
without replacing it with anything, while remaining within the limits of Laplace’s 
method: after all, if f(x) =0 in a neighborhood of a maximum xo of the function 
S(x) or if f(x) tends to zero very rapidly as x — xo, then xp may not be respon- 
sible for the asymptotics of the integral. Now that we have arrived at a certain type 
of asymptotic sequence {e*CA—Pk} (Po < pi <-:++) as A > +00 as a result of the 
considerations we have studied, we can speak of an asymptotic zero in relation to 
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such a sequence and, without assuming that f (x9) 4 0, we can state the localiza- 
tion principle as follows: Up to an asymptotic zero with respect to the asymptotic 
sequence {e*50),—Pk} (pg < py < +++) the asymptotic behavior of the Laplace in- 
tegral (19.1) as A —> +00 equals the asymptotics of the portion of this integral taken 
over an arbitrarily small neighborhood of the point xo, provided that this point is 
the unique maximum of the function S(x) on the interval of integration. 

However, we shall not go back and re-examine these questions in order to sharpen 
them. Rather, assuming f and S belong to C‘©), we shall give a derivation of the 
corresponding asymptotic expansions using Lemma | on the exponential estimate, 
Lemma 3 on the change of variable, and Watson’s lemma (Lemma 4). 


Theorem 2 (Asymptotic expansion) Let I = [a,b] be a finite interval, f,S € 
CCU, R), and assume max,;¢7 S(x) is attained only at the point xo € I and f,S€ 
C‘©)(U;(xo), R) in some neighborhood U;(xo) of xo. Then in relation to the 
asymptotics of the integral (19.1) the following assertions hold. 


a) If xo =a, S™ (a) £0, SY) (a) = 0 for 1 < j <™m, then 


[o.@) 
Faye ame SOS an" ash > +00, (19.16) 
k=0 


where 


—1)ktlmk /k +1 d\* 
a a m r( . ) (ne.0=) (f(x)h(x,a))|_,. 


h(x,a) = (S(a) — Sx)‘ "/"/8"(x). 
b) Ifa <xo <b, S?” (xo) £0, and SY (x9) = 0 for 1 < j < 2m, then 


CO 
F(A) = A120) 5 cg H/™ as 4 > +00, (19.17) 
k=0 


where 


(—1)2*+1(2m)?* (2k +1 a 
ck = 2p r( 2m ) (nex) CF )BCE 0) ap 


h(x, x0) = (S(x0) — S(x))'-2" /S"(x). 


c) If f (xo) £0 and f(x) ~ 4, f™ (xo)(x — x0)" as x > xo, then the main 
term of the asymptotics in the cases a) and b) respectively has the form 


ntl 
Fast Hesor(7t! Loan 
m m |S" (a)| 


«(Ss a+ o0-*)], (19.18) 
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n+l 
1 _n4t n+1 (2m)! \ 2 
F(A) = —)7 me S@0) P 
a 2m J\IS™ ol) * 


n+l 


x | fo) + O(A~ 2m )} (19.19) 
nN: 


d) The expansions (19.16) and (19.17) can be differentiated with respect to r 
any number of times. 


Proof It follows from Lemma | that under these hypotheses the integral (19.1) can 
be replaced by an integral over an arbitrarily small neighborhood of xg up to a 
quantity of the form e*50) O(A~™) as A > 00. 

Making the change of variable x = g() from Lemma 3 in such a neighborhood, 
we bring the last integral into the form 


cee I (f op)(y)p' ye" dy, eee) 


where I, = [0, €], a =m if x9 =a, and Jy = [—e, €], a = 2m ifa < x9 <b. 

The neighborhood in which the change of variable x = g(y) took place can be 
assumed so small that both functions f and S are infinitely differentiable in it. Then 
the resulting integrand (f o ~)(y)g’(y) in the integral (19.20) can also be assumed 
infinitely differentiable. 

If Jy = [0, e], that is, when x9 = a, Watson’s lemma is immediately applicable to 
the integral (19.20) and the existence of the expansion (19.16) is thereby proved. 

If J, =[—e, e], that is, in the case a < xo < b, we bring the integral (19.20) into 
the form 


eh 5) il [Fomine + Fo~(-ye'(-y)Je" dy, (19.21) 


and, once again applying Watson’s lemma, we obtain the expansion (19.17). 

The possibility of differentiating the expansions (19.16) and (19.17) follows from 
the fact that under our assumptions the integral (19.1) can be differentiated with 
respect to A to yield a new integral satisfying the hypotheses of the theorem. We 
write out the expansions (19.16) and (19.17) for it, and we can verify immediately 
that these expansions really are the same as those obtained by formal differentiation 
of the expansions (19.16) and (19.17) for the original integrals. 

We now take up the formulas for the coefficients a, and cy. By Watson’s lemma 
a = gig SE OTE), where P(y) = (f 0 g)(9)9'(9). 

However, taking account of the relations 


S(g()) — Sa) =-y", 
S'(x)¢'(y) = —my™|, 


g'(y) = —m(S(a) — S(x))'7"/8'@), 
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d ,.d 
dy =F Oa 
P(y) = f(x)e'(y), 
we obtain 


a 
ae (0) =(—m r+ (nex, aa) (Ona) |. 


where h(x, a) = (S(a) — S(x))!-m /8/(x). 

Formulas for the coefficients cx, can be obtained similarly by applying Watson’s 
lemma to the integral (19.21). 

Setting w(y) = f(e(y))¢'(y) + f(@(—y))¢'(- 9), we can write, as A > +00, 


. i te ee 
/ Wye" dy = > Or(S Jae 
0 


2m n! 2m 
n=0 


But, pet) (0) = 0 since w(y) is an even function; therefore this last asymptotic 
expansion can be rewritten as 


€ oo (2k) 
—ay2m 1 we (0) Qk+1\. _ 2x41 
~ dy~a T Xm, 
[ ¥Oe 4 2m (2k)! 2m 


It remains only to note that y?) (0) = 26?" (0), where ®(y) = f (v(y))g'(y). 
The formula for cx, can now be obtained from the already established formula for a, 
by replacing k with 2k and doubling the result of the substitution. 

To obtain the principal terms (19.18) and (19. i) in the asymptotic expansions 
(19.16) and (19.17) under the condition f(x) = af (xo) (x — xo)" + O((x — 
xo)"t!) indicated in c), where f (xo) 4 0, it sities to recall that x = g(y), 
x0 = 9(0), x — x0 = g'(0)y + O(y”), that is, 

fo) 
(fop)=y" (Foy + OW) 
and 


(n) 
(foggy) =y" (CP wo + 009) 


)!/™ J 0 if x9 = a and g'(0) = ( (2m!) yl/2m z 


as y > 0, since y’(0) = (~=— JS") Go) 


|S ona 
Oifa<x9 <b. 
It now remains only to substitute these expressions into the integrals (19.20) and 


(19.21) respectively and use formula (19.13) from Watson’s lemma. 


Remark 2 We again get formula (19.2’) from formula (19.18) when n = 0 and 
m=1. 
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Similarly, when n = 0 and m = 1 formula (19.19) yields (19.3’) again. 
Finally, Eq. (19.4’) comes from Eq. (19.18) with n = 0 and m = 2. 
All of this, of course, assumes the hypotheses of Theorem 2. 


Remark 3 Theorem 2 applies to the case where the function S(x) has a unique max- 
imum on the interval J = [a, b]. If there are several such points x1, ..., Xn, the inte- 
gral (19.1) is partitioned into a sum of such integrals, each of whose asymptotics is 
described by Theorem 2. That is, in this case the asymptotic behavior is obtained as 
the sum Vin F(A, x;) of the contributions of these maximum points. 

It is easy to see that when this happens, some or even all of the terms may cancel 
one another. 


Example 11 If S € C‘°)(R, R) and S(x) > —oo as x > 00, then 


oe) 
F(A) =| S'(x)S dx =0 fora>0. 
[o,@) 


Hence, in this case such an interference of the contributions must necessarily occur. 
From the formal point of view this example may seem unconvincing, since previ- 
ously we had been considering the case of a finite interval of integration. However, 
those doubts are removed by the following important remark. 


Remark 4 To simplify what were already very cumbersome statements in The- 
orems | and 2 we assumed that the interval of integration J was finite and 
that the integral (19.1) was a proper integral. In fact, however, if the inequality 
SUP7\ U(x9) S(x) < S(xo) holds outside an interval U(x) of the maximum point 
xo € I, then Lemma | enables us to conclude that the integrals over intervals strictly 
outside of U(xo) are exponentially small in comparison with e*50) as 1 + +00 
(naturally, under the assumption that the integral (19.1) converges absolutely for at 
least one value 4 = Ag). 

Thus both Theorem | and Theorem 2 are also applicable to improper integrals if 
the conditions just mentioned are met. 


Remark 5 Due to their cumbersome nature, the formulas for the coefficients ob- 
tained in Theorem 2 can normally be used only for obtaining the first few terms of 
the asymptotics needed in specific computations. It is extremely rare that one can 
obtain the general form of the asymptotic expansion of even a simpler function than 
appears in Theorem 2 from these formulas for the coefficients a, and cz. Neverthe- 
less, such situations do arise. To clarify the formulas themselves, let us consider the 
following examples. 


Example 12 The asymptotic behavior of the function 


+00 2 
Ext) = [ edu 
x 
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as x — +00 is easy to obtain through integration by parts: 


—x? +00 x? Xx +Oo 

1 3 

Erf(x) = ee i ue" du = © + sco +| gi’ apess: : 
2x 2 Sx 2x 22x3 = 


from which, after obvious estimates, it follows that 


—x2 00 k 
—1)k 2k — 1)! 
Erf(x) ~ ye ) ee ee ee (19.22) 


k=0 


Let us now obtain this expansion from Theorem 2. 
By the change of variable u = xt we arrive at the representation 


“+00 242 
Erf(x) eh e dt. 
1 


Setting A = x” here and denoting the variable of integration, as in Theorem 2, by x, 
we reduce the problem to finding the asymptotic behavior of the integral 


oo @ 
F(A)= / ee dx, (19.23) 
1 


since Erf(x) = x F (x2). 

When Remark 4 is taken into account, the integral (19.23) satisfies the hypothe- 
ses of Theorem 2: S(x) = —x?, S’(x) = —2x <0 for 1 <x < +00, S’(1) = -2, 
Sa) =-1. 

Thus, x» =a=1,m=1, fx)=1hG, a= sho ada". 

Hence, 


(=%) ( ll 7s 5) ¢ px", 
(58) (2-40) (aye) 


1 3 
- (-;) Dea, 


k 
1 od 1 = (2k — I)! kt) 
—2x dx 2x Qk+1 ; 
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Setting x = 1, we find that 


, (2k — 1)! 
={-1) Dk+1 


—1)1 2k — 1)! 
po 2) 


Now writing out the asymptotic expansion (19.16) for the integral (19.23) taking 
account of the relations Erf(x) = x F(x), we obtain the expansion (19.22) for the 
function Erf(x) as x — +00. 


Example 13 In Example 7, starting from the representation 


+00 
POA a ae) ete) ay (19.24) 
0 


we obtained the principal term of the asymptotics of the function (A + 1) asA > 
+oo. Let us now sharpen the formula obtained earlier, using Theorem 2b). 

To simplify the notation a bit, let us replace x by x + 1 in the integral (19.24). 
We then find that 


+ 
rat 1) = ecie® % gMin(1-+x)—x) dx 
-l 


and the question reduces to studying the asymptotics of the integral 
+00 
FA)= / ein tx)—x) dy (19.25) 
-1 


as A > +00. Here S(x) =In(1+x)— x, S’(x) = “5 —1, S’(0) =O, that is, xp = 0, 


S"(x)=—- ees S” (0) = —1 £0. That is, taking account of Remark 4, we see that 


the hypotheses b) of Theorem 2 are satisfied, where we must also set f(x) = 1 and 
m= 1, since S”(0) £0. 
In this case the function h(x, x9) = h(x) has the following form: 


1+x 1/2 


h(x) =— 


(x — In(1 + x)) 


If we wish to find the first two terms of the asymptotics, we need to compute the 
following at x = 0: 


4 \? 
(ui =) (h(x)) =h(x), 


d\! dh 
(Hm) (A(x) =h)T @), 
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ay d dh 
(ne) (h(x) = (ne) (1 Zo) a 


=f a 
- | (S) (x) + w530)], 


This computation, as one can see, is easily done if we find the values h(0), h’(0), 
h” (0), which in turn can be obtained from the Taylor expansion of h(x), x >Oina 
neighborhood of 0: 


ney =—-A8* |e (2- pte o))] = 
= aa Pesttso()] = 
- 4 E at xt oy] = 
= a (: 3 + 36° + o(x')) = 
= = Y, + =a + O(x?) 


Thus, h(0) = —5, h'(0) =—2, h"(O) = Se 


d \2? 1 
(n=) (4) nao =F 


1 


d 1 
(n=) (@))|n20 = 3° 


Hence, as 4 > oo, 


F(a) = Vinx + oir + 00), 
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that is, as A > +00, 
a Pos rz 
PA+)=Vv27A(- 1+ 754 + O(a~*) }. (19.26) 
e 


It is useful to keep in mind that the asymptotic expansions (19.16) and (19.17) can 
also be found by following the proof of Theorem 2 without invoking the expressions 
for the coefficients shown in the statement of Theorem 2. 

As an example, we once again obtain the asymptotics of the integral (19.25), but 
in a slightly different way. 

Using the localization principle and making a change of variable x = g(y) ina 
neighborhood of zero such that 0 = g(0), S(g(y)) = Indl + ¢())) — ¢0) = =, 
we reduce the problem to studying the asymptotics of the integral 


[ oye?" dy = [ we” ay, 


where w(y) = g'(y) + y’(—y). The asymptotic expansion of this last integral can 
be obtained from Watson’s lemma 


(k) 
[ yore” dy =~ ye Op r(S)a “K+D/2 ag, > +00, 


210 


which by the relations y?+) (0) = 0, w?” (0) = 2gP+) (0) yields the asymp- 
totic series 


oo 2k+1 2k+1 
py aul mor, k=) HD = 12 p aie oe 
f= (2k!) 2 k122k 


Thus for the integral (19.25) we obtain the following asymptotic expansion 


p@kt)) (0). _ 


F(A)XA RY ik , (19.27) 


where x = ¢(y) is asmooth function such that x —In(1+x) = y? in a neighborhood 
of zero (for both x and y). 

If we wish to know the first two terms of the asymptotics, we must put the specific 
values y’(0) and g®) (0) into formula (19.27). 

It may be of some use to illustrate the following device for computing these 
values, which can be used generally to obtain the Taylor expansion of an inverse 
function from the expansion of the direct function. 

Assuming x > 0 and y > 0, from the relation 


x —In(l+x)=y’ 
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we obtain successively 


l 4 


2 1 
pe(i pt pet oe) )=x 


2 
x=viy(1- 3x45 =x + O(x i. = 


2 


=Vi(14 50-5? + O(x ))= 


= Viv + Py — yet *+ O(yx?). 


But x ~ /2y as y > 0 (x > 0), and therefore, using the representation of x 
already found, one can continue this computation and find that as y > 0 


x=vV2y+ 2s (vay4 WP ye or) - 2 yJByy + O(y*) = 


2 2 
= V2y+5y"+ 


af 2. 
2 3 O(y4* 
3 Cae ad (") 


aaa = a sy) - 234 0(y")= 


= Viy + 5y" +2, + O(y*). 


Thus for the quantities g’(0) and g®) (0) of interest to us we find the following 


values: g’ (0) = V2, 9 (0) = v2 
Substituting them into formula (19.27), we find that 


1 
FA)= sa + ae + 0) as h > +00, 


from which we again obtain formula (19.26). 
In conclusion we shall make two more remarks on the problems discussed in this 
section. 


Remark 6 (Laplace’s method in the multidimensional case) We note that Laplace’s 


method can also be successfully applied in studying the asymptotics of multiple 
Laplace integrals 


FQ)= / Fe dy, 
XxX 


in which x € R”, X is a domain in R”, and f and S are real-valued functions in X. 
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Lemma | on the exponential estimate holds for such integrals, and by this lemma 
the study of the asymptotics of such an integral reduces to studying the asymptotics 
of a part of it 


/ f(xy dx, 
U(x0) 


taken over a neighborhood of a maximum point xo of the function S(x). 

If this is a nondegenerate maximum, that is, S” (x9) 4 0, then by Morse’s lemma 
(see Sect. 8.6 of Part 1) there exists a change of variable x = y(y) such that S(xo) — 
S(p(y)) = |y|?, where |y|? = (y!)? + --- + (y”)*. Thus the question reduces to the 
canonical integral 


i: (f oy) dety'(ye*?” ay, 


which in the case of smooth functions f and S can be studied by applying Fubini’s 
theorem and using Watson’s lemma proved above (see Problems 8-11 in this con- 
nection). 


Remark 7 (The stationary phase method) In a wider interpretation, Laplace’s 
method, as we have already noted, consists of the following: 

1° a certain localization principle (Lemma | on the exponential estimate), 

2° a method of locally reducing an integral to canonical form (Morse’s lemma), 
and 

3° a description of the asymptotics of canonical integrals (Watson’s lemma). 


We have met the idea of localization previously in our study of approximate iden- 
tities, and also in studying Fourier series and the Fourier transform (the Riemann— 
Lebesgue lemma, smoothness of a function and the rate at which its Fourier trans- 
form decreases, convergence of Fourier series and integrals). 

Integrals of the form 


F(A) =| f (xe dx, 
XxX 


where x € R", called Fourier integrals, occupy an important place in mathematics 
and its applications. A Fourier integral differs from a Laplace integral only in the 
modest factor i in the exponent. This leads, however, to the relation |e*5@)| = 1 
when A and S(x) are real, and hence the idea of a dominant maximum is not appli- 
cable to the study of the asymptotics of a Fourier integral. 

Let X =[a,b] CR', fe Ca: b], R), (that is, f is of compact support on 
[a, b]), S € C©? ({a, b], R) and S’(x) £0 on [a, b]. 

Integrating by parts and using the Riemann—Lebesgue lemma (see Problem 12), 
we find that 


A b 
; FeO aya t [LO gers — 
a ix a S’(x) 
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b 
me eee fe (x)el*S@ dx = 
iA Jag dx \S’ 

1 ‘ iAS(x 1 
= @Mqyae.- 
= x)e dx =---= — 

. / fi) a 


= 0(a~”) asa oo. 


b 
| falxye dx = 
a 


Thus if S’(0) 4 0 on the closed interval [a, b], then because of the constantly 
increasing frequencies of oscillation of the function e'*5@) as A — oo, the Fourier 
integral over the closed interval [a, b] turns out to be a quantity of type O(A~%). 

The function S(x) in the Fourier integral is called the phase function. Thus the 
Fourier integral has its own localization principle called the stationary phase prin- 
ciple. According to this principle, the asymptotic behavior of the Fourier integral 
as 4 + oo (when f € ratte is the same as the asymptotics of the Fourier integral 
taken over a neighborhood U (x9) of a stationary point xo of the phase function (that 
is, a point x9 at which S’(xo9) = 0) up to a quantity O(A~°). 

After this, by a change of variable the question reduces to the canonical integral 


E(Q)= is f (xe dx 
0 


whose asymptotic behavior is described by a special lemma of Erdélyi, which plays 
the same role for the Fourier integral that Watson’s lemma plays for the Laplace 
integral. 

This scheme for investigating the asymptotics of a Fourier integral is called the 
stationary phase method. 

The nature of the localization principle in the stationary phase method is com- 
pletely different from its nature in the case of the Laplace integral, but the general 
scheme of Laplace’s method, as one can see, remains applicable even here. 

Certain details relating to the stationary phase method will be found in Prob- 
lems 12-17. 


19.2.6 Problems and Exercises 


Laplace’s Method in the One-Dimensional Case 

1. a) Fora > 0 the function h(x) = e**" attains its maximum when x = 0. Here 

h(x) is a quantity of order | in a 6-neighborhood of x = 0 of size 6 = O(a l/*), 
Using Lemma 1, show that if 0 < 6 < 1, then the integral 


W@)= [ x8-! Fixe" dx, 


(4,6) 


where c(A, 5) = pcm has order O(e~4") as 4 — +00, A being a positive constant. 
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b) Prove that if the function f is continuous at x = 0, then 
W(A) =a 'T'(B/a)[ f (0) +0(1)]a- 8" as A> +00. 


c) In Theorem la), the hypothesis f(x) = f (xo) + O(x — xo) can be weakened 
and replaced by the condition that f be continuous at xo. Show that when this 
is done the same principal term of the asymptotics is obtained, but in general not 
Eq. (19.2’) itself, in which O(x — xg) is now replaced by o(1). 


2. a) The Bernoulli numbers B,; are defined by the relations 
CO 


1 1 B 
ae 2k y2k-1 Ue) < On, 
k=1 Qk" 


It is known that 


r’ e/i Ft ‘ue 
Tr (x) =Inx + . , (ae e dt. 


Show that 
a i <3 
(=) (x) x Inx — oa 22k 2k as x > +00. 


b) Prove that as x — +-oo 


1 I Box —2k+1 
nr) (3 ;) ns chyna at . 


This asymptotic expansion is called Stirling’s series. 

c) Using Stirling’s series, obtain the first two terms of the asymptotics of 
I'(x + 1) as x — +00 and compare your result with what was obtained in Ex- 
ample 13. 

d) Following the method of Example 13 and independently of it using Stirling’s 
series, show that 


. 1 1 1 
T(x+l=v2rx ef 1+ + +0 as x + +00. 
e 12x x3 


288.x2 


3. a) Let f € C({0,a],R), S e¢ C(O, a], R), S(x) > 0 on [0, a], and suppose 
S(x) attains its maximum at x = 0, with S’(0) 4 0. Show that if f(0) 4 0, then 


f (0) 


A+1 
150) Sov" (0) asA—> +00. 


I(A):= [ f (x) S4 (x) dx ~ — 
0 
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b) Obtain the asymptotic expansion 


lo) 
TQ) S**!(0) aed er as 4 > +400, 
k=0 


if it is known in addition that f, S € C°({0, a], R). 
4. a) Show that 


m/2 Sete 1 zg 
. sin” t dt = [5 (1+ O(n )) asn — +00. 


b) Express this integral in terms of Eulerian integrals and show that for n € N it 
equals Q2n—D! x 


(Qnyi! ° 2° 
c) Obtain Wallis’ formula 7 = limn+oo (ga ay)”. 


d) Find the second term in the asymptotic expansion of the original integral as 
n— +00. 


5. a) Show that f!,(1—x?)"dx ~ [2 as n > +00. 
b) Find the next term in the asymptotics of this integral. 


6. Show that if a > 0, then as x > +00 
+00 2 
/ te dt ~ | exp(Sx"), 
0 ee e 
7. a) Find the principal term of the asymptotics of the integral 
+00 
/ (4+1t)"e "dt asn— +o. 
0 


b) Using this result and the identity k!n—* = i e—"'t* dt, show that 


n 
ye chin ae > ( + O(n~')) asn — +00. 
k=0 


Laplace’s Method in the Multidimensional Case 


8. The exponential estimate lemma. Let M = sup,-p S(x), and suppose that for 
some A = Ag the integral 


FQ) = i! F(xye da (*) 
DcR" 
converges absolutely. Show that it then converges absolutely for 4 > Ao and 


|f@)|< ii | forje® | dx < Ae (A> do), 


where A is a positive constant. 
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9. Morse’s lemma. Let xo be a nondegenerate critical point of the function S(x), 
x € R", defined and belonging to class C‘©) in a neighborhood of xo. Then there 
exist neighborhoods U and V of x = xo and y = 0 and a diffeomorphism g : V > U 
of class C‘°)(V, U) such that 


n 


1 2 
S(y()) = S(xo) + 5 yO). 
j=l 
where detg’(0) = 1, v1,...,V, are the eigenvalues of the matrix S'’.(xo), and 


y!,..., y” are the coordinates of y € R”. 

Prove this slightly more specific form of Morse’s lemma starting from Morse’s 
lemma itself, which is discussed in Sect. 8.6 of Part 1. 
10. Asymptotics of a canonical integral. 


a) Let t = (t,...stn), V = {t © R" | |tj| < 6,j = 1,2,...,n}, and ae 
c‘©)(V, IR). Consider the function 


, : 24M 42 
Fi(a,¢’) = a(t},...,t)e 2 | dty, 
—3d 


where f! = (t),...,f) and v, > 0. Show that Fy(A, 0’) Y Wy ag(t’)a7 kD 
as A — +00. This expansion is uniform in t/ € V’! = {t’ € R™! | |t/| <6, j= 
2,...,n} and az € C®)(V’, R) for every k=0,1,.... 

b) Multiplying F,(A, t’) by roe and justifying the termwise integration of 
the corresponding asymptotic expansion, obtain the asymptotic expansion of the 
function 


6 Av 
Fi(a, re 2 dtz asA— +00, 


F(a, 0”) = / 


—6s 


where t” = (f3,...,t1), v2 > 0. 
c) Prove that for the function 


Ayu 2 
Aa)= | vf A(t, ...,tp)e 2 Va FF dt ---dty, 
nae’ = ashech 


where v; > 0, j = 1,...,n, the following asymptotic expansion holds: 


CO 
A(a) x Av ?/2 Yi aya* as 4 > +00, 


k=0 
where ao = ,/ ee" a(0). 
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11. The asymptotics of the Laplace integral in the multidimensional case. 


a) Let D be a closed bounded domain in R”, f, S € C(D,R), and suppose 
max;ep S(x) is attained only at one interior point x9 of D. Let f and S be C (0°) in 
some neighborhood of xo and det S” (xo) 4 0. 

Prove that if the integral (*) converges absolutely for some value 4 = Ao, then 


CO 
F(A) © et 5@0) 7/2 > a,ra—*  asi—> +00, 
k=0 


and this expansion can be differentiated with respect to 4 any number of times, and 
its principal term has the form 


= (27)" = 
_— ,AS(x9) n/2 1 
F(A) =e? 0), TReRUETT det "eo (f (xo) + O(A~")). 


b) Verify that if instead of the relation f, S € C‘©) all we know is that f € C 
and S € C®) in a neighborhood of xo, then the principal term of the asymptotics as 
2. — +00 remains the same with O(A~!) replaced by o(1) as A > +00. 


The Stationary Phase Method in the One-Dimensional Case 
12. Generalization of the Riemann—Lebesgue lemma. 


a) Prove the following generalization of the Riemann—Lebesgue lemma. 
Let S € C ({a, b], R) and S’(x) £0 on [a, b] =: I. Then for every function f 
that is absolutely integrable on the interval J the following relation holds: 


b 
F(A) =i f(xje?S dx +0 asd—>oo, AER. 
a 


b) Verify that if it is known in addition that f ¢ C’*)(,R) and Se 
C+2 (7, R), then as A > 00 


we ae (pay 1 ae 
FO)= Dm (<53 @ 


’ + ala), 


a 


c) Write out the principal term of the asymptotics of the function F(A) ask > 
oo, AER. 

d) Show that if S€ C?(I,R) and f |fa,c) € C [a,c], f\fc,o] € C Le, b], but 
t¢ Ca, b], then the function F(A) is not necessarily o(A—!) as 4 > of. 

e) Prove that when f,S eC () (7, R), the function F (A) admits an asymptotic 
series expansion as 4 > oo. 

f) Find asymptotic expansions as A + oo, A € R, for the following integrals: 
ic +x)? wi(x,A)dx, j = 1,2,3, if a > 0 and yy = eax wW2 = cosdrx, and 
w3 = sindax. 
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13. The localization principle. 


a) Let 1 =[a,b] CR, f € C&R), S € CO UH,R), and S’(x) £0 on I. 
Prove that in this case 


b 
F(A) = F(xje?S™ dx = O(|AI™) asd ov. 


b) Suppose f ¢ CO U,R), S€ CU, R), and x1,...,Xm is a finite set of 
stationary points of S(x) outside which S’(x) 4 0 on J. We denote by F (A, xj) 
the integral of the function f(x)e!*5 over a neighborhood U (x;) of the point x;, 
j=1,...,m, not containing any other critical points in its closure. Prove that 


m 
Fa)= 0 FA, xj) + O(|Al-%) asd oo. 
j=l 
14. Asymptotics of the Fourier integral in the one-dimensional case. 


a) Inareasonably general situation finding the asymptotics of a one-dimensional 
Fourier integral can be reduced through the localization principle to describing the 
asymptotics of the canonical integral 


a 
E(A) -|/ xP-! Fel dx, 
0 
for which the following lemma holds. 


Erdélyi’s lemma Let a > 1, 6B > 0, f ¢ C®({0,a],R) and f(a) =0, k = 
0,1,2,.... Then 


lee) 
k+B 
EQ)= laa ash +00, 
k=0 


where 


a 


— a 
om kt” 


1 (AP) fOO) 


and this expansion can be differentiated any number of times with respect to x. 


Using Erdélyi’s lemma, prove the following assertion. 

Let J = [xo — 5, x9 + 6] be a finite closed interval, let f, S ¢ CJ, R) with 
f €CoU, R), and let S have a unique stationary point x9 on J, where S’(xo) = 0 
but S” (xo) 4 0. Then as 4 — +00 


~ xo+d . “ao . 1 te 
F(A, x0) =] f x)ePS@ dx x ef 25° G0) i500) — 3 Yo aya* 
xo—6 k=0 
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and the principal term of the asymptotics has the form 


2 


F(A, x0) = 
Xi = ————_ 
80" VAIS” xo) 


ei (Z sgn 8" (x0) +4.5(x0)) (f (xo) +4 o(a')). 
b) Consider the Bessel function of integer order n > 0: 


1 us 
Jn (x) = -| cos(x sing — ng) dg. 
0 


Show that 


In(s) = = eos(x = 7) +007) | as x > +00. 


The Stationary Phase Method in the Multidimensional Case 


15. The localization principle. 


a) Prove the following assertion. Let D be a domain in R”, f € Cw, R), 
S€C™)(D,R), grad S(x) 4 0 for x € supp f, and 


F(a) =f f (x)el*S@ dy. (#*) 
D 


Then for every k € N there exists a positive constant A(k) such that the estimate 
|F(A)| < A(k)A7* holds for 4 > 1, and hence F(A) = O(A~%) as A > +00. 

b) Suppose as before that f € CD, R), S ¢ CD, R), but S has a finite 
number of critical points x;,...,xX,, outside which grad S(x) 4 0. We denote by 
F(A, x;) the integral of the function f (x)e'4S@) over a neighborhood U (x;) of x; 
whose closure contains no critical points except x;. Prove that 


FQ@)= Yo FQ x) + O(a-*) asA—> +00. 
j=l 


16. Reduction to a canonical integral. If xp is a nondegenerate critical point of 
the function S € C‘°)(D, R) defined in a domain D C R", then by Morse’s lemma 
(see Problem 9) there exists a local change of variable x = g(y) such that x9 = 
g(0), S(p(y)) = S(xo) + pe ej()?, whetees= tl y= Oy psaxg 9), and 
det y'(y) > 0. 

Using the localization principle (Problem 15), now show that if f € COD, R), 
S €C©)(D,R), and S has at most a finite number of critical points in D, all non- 
degenerate, then the study of the asymptotics of the integral (**) reduces to studying 
the asymptotics of the special integral 


6 6 ik n j 
P(A) =I a v(yt,... yt)e? Rint 70 dyt.. dy" 
—6§ —§ 
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17. Asymptotics of a Fourier integral in the multidimensional case. Using Erdélyi’s 
lemma (Problem 14a)) and the scenario described in Problem 10, prove that if D 
is a domain in R”, f, Se€ Cc) (D,R), supp f is a compact subset of D, and xo is 
the only critical point of S' in D and is nondegenerate, then for the integral (**) the 
following asymptotic expansion holds as 4 — +00: 


(oe) 
F(A) ~ A212 iA S (x0) yar, 
k=0 


which can be differentiated any number of times with respect to 2. 
The main term of the asymptotics has the form 


= x n/2 ix i 
FA)= (=) exp] i2S(00) + 5 sgn S$ co) x 
x |det S" xo) |” [ Fo) + o(a')] as A — +Loo. 


Here S’(x) is the symmetric and by hypothesis nonsingular matrix of second 
derivatives of the function S at xo (the Hessian), and sgn S” (xo) is the signature of 
this matrix (or the quadratic form corresponding to it), that is, the difference v — v_ 
between the number of positive and negative eigenvalues of the matrix S” (xo). 


Topics and Questions for Midterm Examinations 


1 Series and Integrals Depending on a Parameter 


1. The Cauchy criterion for convergence of a series. The comparison theorem and 
the basic sufficient conditions for convergence (majorant, integral, Abel—Dirichlet). 
The series €(s) = °- ,n. 

2. Uniform convergence of families and series of functions. The Cauchy criterion 
and the basic sufficient conditions for uniform convergence of a series of functions 
(M-test, Abel—Dirichlet). 

3. Sufficient conditions for two limiting passages to commute. Continuity, integra- 
tion, and differentiation and passage to the limit. 

4. The region of convergence and the nature of convergence of a power series. The 
Cauchy—Hadamard formula. Abel’s (second) theorem. Taylor expansions of the ba- 
sic elementary functions. Euler’s formula. Differentiation and integration of a power 
series. 

5. Improper integrals. The Cauchy criterion and the basic sufficient conditions for 
convergence (M-test, Abel—Dirichlet). 

6. Uniform convergence of an improper integral depending on a parameter. The 
Cauchy criterion and the basic sufficient conditions for uniform convergence (ma- 
jorant, Abel—Dirichlet). 

7. Continuity, differentiation, and integration of a proper integral depending on a 
parameter. 

8. Continuity, differentiation, and integration of an improper integral depending on 
a parameter. The Dirichlet integral. 

9. The Eulerian integrals. Domains of definition, differential properties, reduction 
formulas, various representations, interconnections. The Poisson integral. 

10. Approximate identities. The theorem on convergence of the convolution. The 
classical Weierstrass theorem on uniform approximation of a continuous function 
by an algebraic polynomial. 
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2 Problems Recommended as Midterm Questions 


d 
Problem 1 P is a polynomial. Compute (e' dv) P(x). 
Problem 2 Verify that the vector-valued function e’4x9 is a solution of the Cauchy 
problem x = Ax, x(0) = xo. (Here x = Ax is a system of equations defined by the 
matrix A.) 


Problem 3 Find up to order o(1/n*) the asymptotics of the positive roots A, < 
Ag <+++ <A, <--- of the equation sinx + 1/x =Oasn— ow. 


Problem 4 a) Show that In2 = 1 — 1/2+ 1/3 —---. How many terms of this series 
must be taken to determine In2 within 1077? 

b) Verify that 5 In a Sit xe + ia + .--. Using this expansion it becomes 
1+t 


convenient to compute Inx by setting x = 7. 


c) Setting t = 1/3 in b), obtain the equality 


Le ee re ae 
nz= ek 
2 3°° 3X3 5\3 
How many terms of this series must one take to find In2 within 10-3? Compare 


this with the result of a). 
This is one of the methods of improving convergence. 


Problem 5 Verify that in the sense of Abel summation 


a) 1-141--=4. 
b) Vey sinkg = 5-49, 94 2nn, neEZ. 
c) 5+ 2, cosky =0, 9 #2nn, ne Z. 


Problem 6 Prove Hadamard’s lemma: 


a) If f eC“) (U(x0)), then f(x) = f (xo) + (x) (x — xo), Where g € C(U(x0)) 
and g(xo) = f’ (xo). 
b) If f eC” (U(xo)), then 


1 
f(x) = f (x0) + qf Go — x0) +o + 


1 


Ga pit PAG — 20)! + OO) = x0)", 


+ 


where g € C(U(xo)) and g(x) = 4 f (x0). 
c) What do these relations look like in coordinate form, when x = (x eae x"), 
that is, when f is a function of n variables? 
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Problem 7 a) Verify that the function 


1 f! cosxt 
Jo(x) = — ——— dt 
tJo V1—#2 


satisfies Bessel’s equation y” + ty +y=0. 
b) Try to solve this equation using power series. 
c) Find the power-series expansion of the function Jo(x). 


Problem 8 Verify that the following asymptotic expansions hold 
a) I'(a, x) oie. rer dP ae “Lie 1 Tata ee 
+oo = 
b) Erf(x) := is Se e dt ~ 5Vme x yt Tae 
as x — +00. 


Problem 9 a) Following Euler, obtain the result that the series 1 — 1!x + 2!x? 
3!x3 +--- is connected with the function 


+00 got 
S(x) = / dt. 
0 


b) Does this series converge? 
c) Does it give the asymptotic expansion of S(x) as x > 0? 


Problem 10 a) A linear device A whose characteristics are constant over time 
responds to a signal d(t) in the form of a 6-function by giving out the signal 
(function) E(t). What will the response of this device be to an input signal f(t), 
—00 <t<+o0? 

b) Can the input signal f always be recovered uniquely from the transformed 
signal f= Af? 


3 Integral Calculus (Several Variables) 


1. Riemann integral on an n-dimensional interval. Lebesgue criterion for existence 
of the integral. 

2. Darboux criterion for existence of the integral of a real-valued function on an 
n-dimensional interval. 

3. Integral over a set. Jordan measure (content) of a set and its geometric mean- 
ing. Lebesgue criterion for existence of the integral over a Jordan-measurable set. 
Linearity and additivity of the integral. 

4. Estimates of the integral. 

5. Reduction of a multiple integral to an iterated integral. Fubini’s theorem and its 
most important corollaries. 
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6. Formula for change of variables in a multiple integral. Invariance of measure and 
the integral. 
7. Improper multiple integrals: basic definitions, majorant criterion for conver- 
gence, canonical integrals. Computation of the Euler—Poisson integral. 
8. Surfaces of dimension k in R” and basic methods of defining them. Abstract 
k-dimensional manifolds. Boundary of a k-dimensional manifold as a (k — 1)- 
dimensional manifold without boundary. 
9. Orientable and nonorientable manifolds. Methods of defining the orientation of 
an abstract manifold and a (hyper)surface in R”. 

Orientability of the boundary of an orientable manifold. Orientation induced on 
the boundary from the manifold. 
10. Tangent vectors and the tangent space to a manifold at a point. Interpretation of 
a tangent vector as a differential operator. 
11. Differential forms in a region D C R”. Examples: differential of a function, 
work form, flux form. Coordinate expression of a differential form. Exterior deriva- 
tive operator. 
12. Mapping of objects and the adjoint mapping of functions on these objects. 
Transformation of points and vectors of tangent spaces at these points under a 
smooth mapping. Transfer of functions and differential forms under a smooth map- 
ping. A recipe for carrying out the transfer of forms in coordinate form. 
13. Commutation of transfer of differential forms with exterior multiplication and 
differentiation. Differential forms on a manifold. Invariance (unambiguous nature) 
of operations on differential forms. 
14. A scheme for computing work and flux. Integral of a k-form over a k- 
dimensional smooth oriented surface, taking account of orientation. Independence 
of the integral of the choice of parametrization. General definition of the integral of 
a differential k-form over a k-dimensional compact oriented manifold. 
15. Green’s formula on a square, its derivation, interpretation, and expression in the 
language of integrals of the corresponding differential forms. The general Stokes 
formula. Reduction to a k-dimensional interval and proof for a k-dimensional inter- 
val. The classical integral formulas of analysis as particular versions of the general 
Stokes formula. 
16. The volume element on R” and ona surface. Dependence of the volume element 
on orientation. The integral of first kind and its independence of orientation. Area 
and mass of a material surface as an integral of first kind. Expression of the volume 
element of a k-dimensional surface S* C R” in local parameters and the expression 
of the volume element of a hypersurface $”~! C R” in Cartesian coordinates of the 
ambient space. 
17. Basic differential operators of field theory (grad, curl, div) and their connection 
with the exterior derivative operator d in oriented Euclidean space R?. 
18. Expression of work and flux of a field as integrals of first kind. The basic inte- 
gral formulas of field theory in R? as the vector expression of the classical integral 
formulas of analysis. 
19. A potential field and its potential. Exact and closed forms. A necessary differ- 
ential condition for a form to be exact and for a vector field to be a potential field. Its 
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sufficiency in a simply connected domain. Integral criterion for exactness of 1-forms 
and vector fields. 

20. Local exactness of a closed form (the Poincaré lemma). Global analysis. Ho- 
mology and cohomology. De Rham’s theorem (statement). 

21. Examples of the application of the Stokes (Gauss—Ostrogradskii) formula: 
derivation of the basic equations of the mechanics of continuous media. Physical 
meaning of the gradient, curl, and divergence. 

22. Hamilton’s nabla operator and work with it. The gradient, curl, and divergence 
in triorthogonal curvilinear coordinates. 


4 Problems Recommended for Studying the Midterm Topics 


The numbers followed by closing parentheses below refer to the topics 1—22 just 
listed. The closing parentheses dashes are followed by section numbers (for example 
13.4 means Sect. 4 of Chap. 13), which in turn are separated by a dash from the 
numbers of the problems from the section related to the topic from the list above. 

1) 11.1—2,3; 2) 11.1—4; 3) 11.2—1,3,4; 4) 11.3—1,2,3,4; 5) 11.4—6,7 and 
13.2—6; 6) 11.5—9 and 12.5—5,6; 7) 11.6—1,5,7; 8) 12.1—2,3 and 12.4—1,4; 9) 
12.2—1,2,3,4 and 12.5—11; 10) 15.3—1,2; 11) 12.5—9 and 15.3—3; 12) 15.3—4; 
13) 12.5—8,10; 14) 13.1—3,4,5,9; 15) 13.1—1,10,13,14; 16) 12-.4—10 and 13.2— 
5; 17) 14.1—1,2; 18) 14.2—1,2,3,4,8; 19) 14.3—7,13,14; 20) 14.3—11,12; 21) 
13.3—1 and 14.1—8; 22) 14.1—4,5,6. 


Examination Topics 


1 Series and Integrals Depending on a Parameter 


1. Cauchy criterion for convergence of a series. Comparison theorem and the ba- 
sic sufficient conditions for convergence (majorant, integral, Abel—Dirichlet). The 
séties f(s) =n. 

2. Uniform convergence of families and series of functions. Cauchy criterion and 
the basic sufficient conditions for uniform convergence of a series of functions (M- 
test, Abel—Dirichlet). 

3. Sufficient conditions for commutativity of two limiting passages. Continuity, in- 
tegration, and differentiation and passage to the limit. 

4. Region of convergence and the nature of convergence of a power series. Cauchy— 
Hadamard formula. Abel’s (second) theorem. Taylor expansions of the basic ele- 
mentary functions. Euler’s formula. Differentiation and integration of a power se- 
ries. 

5. Improper integrals. Cauchy criterion and the basic sufficient conditions for con- 
vergence (majorant, Abel—Dirichlet). 

6. Uniform convergence of an improper integral depending on a parameter. Cauchy 
criterion and the basic sufficient conditions for uniform convergence (M-test, Abel— 
Dirichlet). 

7. Continuity, differentiation, and integration of a proper integral depending on a 
parameter. 

8. Continuity, differentiation, and integration of an improper integral depending on 
a parameter. Dirichlet integral. 

9. Eulerian integrals. Domains of definition, differential properties, reduction for- 
mulas, various representations, interconnections. Poisson integral. 

10. Approximate identities. Theorem on convergence of the convolution. Classi- 
cal Weierstrass theorem on uniform approximation of a continuous function by an 
algebraic polynomial. 

11. Vector spaces with an inner product. Continuity of the inner product and alge- 
braic properties connected with it. Orthogonal and orthonormal systems of vectors. 
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Pythagorean theorem. Fourier coefficients and Fourier series. Examples of inner 
products and orthogonal systems in spaces of functions. 

12. Orthogonal complement. Extremal property of Fourier coefficients. Bessel’s in- 
equality and convergence of the Fourier series. Conditions for completeness of an 
orthonormal system. Method of least squares. 

13. Classical (trigonometric) Fourier series in real and complex form. Riemann— 
Lebesgue lemma. Localization principle and convergence of a Fourier series at 
a point. Example: expansion of cos(@x) in a Fourier series and the expansion of 
sin(zx)/mx in an infinite product. 

14. Smoothness of a function, rate of decrease of its Fourier coefficients, and rate 
of convergence of its Fourier series. 

15. Completeness of the trigonometric system and mean convergence of a trigono- 
metric Fourier series. 

16. Fourier transform and the Fourier integral (the inversion formula). Example: 
computation of f for f (x) = exp(—a?x?). 

17. Fourier transform and the derivative operator. Smoothness of a function and the 
rate of decrease of its Fourier transform. Parseval’s equality. The Fourier transform 
as an isometry of the space of rapidly decreasing functions. 

18. Fourier transform and convolution. Solution of the one-dimensional heat equa- 
tion. 

19. Recovery of a transmitted signal from the spectral function of a device and the 
signal received. Sampling theorem (Kotel’ nikov—Shannon formula). 

20. Asymptotic sequences and asymptotic series. Example: asymptotic expansion 
of Ei(x). Difference between convergent and asymptotic series. Asymptotic Laplace 
integral (principal term). Stirling’s formula. 


2 Integral Calculus (Several Variables) 


1. Riemann integral on an n-dimensional interval. Lebesgue criterion for existence 
of the integral. 

2. Darboux criterion for the existence of the integral of a real-valued function on an 
n-dimensional interval. 

3. Integral over a set. Jordan measure (content) of a set and its geometric mean- 
ing. Lebesgue criterion for existence of the integral over a Jordan-measurable set. 
Linearity and additivity of the integral. 

4. Estimates of the integral. 

5. Reduction of a multiple integral to an iterated integral. Fubini’s theorem and its 
most important corollaries. 

6. Formula for change of variables in a multiple integral. Invariance of measure and 
the integral. 

7. Improper multiple integrals: basic definitions, the majorant criterion for conver- 
gence, canonical integrals. Computation of the Euler—Poisson integral. 
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8. Surfaces of dimension k in R” and the basic methods of defining them. Ab- 
stract k-dimensional manifolds. Boundary of a k-dimensional manifold as a (k — 1)- 
dimensional manifold without boundary. 
9. Orientable and nonorientable manifolds. Methods of defining the orientation of 
an abstract manifold and a (hyper)surface in R”. 

Orientability of the boundary of an orientable manifold. Orientation on the bound- 
ary induced from the manifold. 
10. Tangent vectors and the tangent space to a manifold at a point. Interpretation of 
a tangent vector as a differential operator. 
11. Differential forms in a region D C R”. Examples: differential of a function, 
work form, flux form. Coordinate expression of a differential form. Exterior deriva- 
tive operator. 
12. Mapping of objects and the adjoint mapping of functions on these objects. 
Transformation of points and vectors of tangent spaces at these points under a 
smooth mapping. Transfer of functions and differential forms under a smooth map- 
ping. A recipe for carrying out the transfer of forms in coordinate form. 
13. Commutation of the transfer of differential forms with exterior multiplication 
and differentiation. Differential forms on a manifold. Invariance (unambiguous na- 
ture) of operations on differential forms. 
14. A scheme for computing work and flux. Integral of a k-form over a k- 
dimensional smooth oriented surface. Taking account of orientation. Independence 
of the integral of the choice of parametrization. General definition of the integral of 
a differential k-form over a k-dimensional compact oriented manifold. 
15. Green’s formula on a square, its derivation, interpretation, and expression in the 
language of integrals of the corresponding differential forms. General Stokes for- 
mula. Reduction to a k-dimensional interval and proof for a k-dimensional interval. 
Classical integral formulas of analysis as particular versions of the general Stokes 
formula. 
16. Volume element on R” and on a surface. Dependence of volume element on 
orientation. The integral of first kind and its independence of orientation. Area and 
mass of a material surface as an integral of first kind. Expression of volume element 
of a k-dimensional surface S* C R” in local parameters and expression of volume 
element of a hypersurface S”~! C R” in Cartesian coordinates of the ambient space. 
17. Basic differential operators of field theory (grad, curl, div) and their connection 
with the exterior derivative operator d in oriented Euclidean space R?. 
18. Expression of work and flux of a field as integrals of first kind. Basic integral 
formulas of field theory in R? as the vector expression of the classical integral for- 
mulas of analysis. 
19. A potential field and its potential. Exact and closed forms. A necessary differ- 
ential condition for a form to be exact and for a vector field to be a potential field. Its 
sufficiency in a simply connected domain. Integral criterion for exactness of 1-forms 
and vector fields. 
20. Local exactness of a closed form (Poincaré’s lemma). Global analysis. Homol- 
ogy and cohomology. De Rham theorem (formulation). 
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21. Examples of the application of the Stokes (Gauss—Ostrogradskii) formula: 


derivation of the basic equations of the mechanics of continuous media. Physical 
meaning of the gradient, curl, and divergence. 


22. Hamilton’s Nabla operator, and computation of work with it. Gradient, curl and 
divergence in a 3-dimensional orthogonal system of curvilinear coordinates. 


Examination Problems 
(Series and Integrals Depending on a Parameter) 


1. We shall consider a sequence of real-valued functions { f,,} defined on the interval 
[0, 1], for example. 


a) What types of convergence for a sequence of functions do you know? 

b) Provide the definition of each of them. 

c) What are the relations between them? (Prove the relation or give an explana- 
tory example when there is no such relation.) 


2. Let f be a periodic function with period 27. Suppose it is identically zero on the 
interval ]—z, O[ and f(x) = 2x on the interval [0, 2]. Calculate the sum S of the 
standard trigonometric Fourier series of this function. 
3. a) We know the expansion in power series of the function (1 + x)! (geometric 
progression). Obtain from it the expansion in a power series of the function In(1+ x) 
and justify your steps. 

b) What is the radius of convergence of the obtained series? 

c) Does this series converge at x = 1, and if so, is its sum equal to In2? Why? 


4. a) It is known that the spectral function (characteristic function) p of a linear 
device (operator) A is everywhere nonzero. How can we find the transmitted signal 
f if we know the function p and the received signal g = Af. 

b) Let the function p be defined by p(w) = 1 for |w| < 10 and p(m) = 0 for 
|w~| > 10. Suppose that we know the spectrum @ (Fourier transform) of the received 
signal g and that it is exactly g(@) = 1 for |w| < 1 and g(w) =0 for |@| > 1. Finally, 
suppose that it is also known that the input signal f does not contain some other 
frequencies apart from the frequencies transmitted by the device A (i.e., beyond the 
frequencies |@| < 10). Find the input signal f. 


5. Using Euler’s I” function and Laplace’s method, obtain the very useful asymp- 
totic Stirling’s formula n! ~ V27n(4)". 
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Intermediate Problems 
(Integral Calculus of Several Variables) 


1. Compute the values of the following forms w in R” on the given set of vectors. 
a) a= x2 dx! applied to the vector € = (1,2, 3) € TRi 233 


b) @=dx! Adx3 +x! dx? Adx* applied to the ordered pair of vectors (&, 2) € 
TR ogy Steet megs Ga — CG annds G5) 


2. Let f!,..., f” be smooth functions with argument x = (x!,...,x”) € R”. Ex- 
press the form df! A--- A df” in terms of the forms dx!,..., dx”. 

3. Let F be a vector field of a force acting on a domain D C R?. By the action 
of this vector field an object was transferred along a smooth path y Cc D from the 
point a € D to the point b € D. Calculate the work done by the vector field in this 
process. 


a) Write the formula for the calculation of this work as an integral of the first 
type and as an integral of the second type (i.e., in terms of ds and dx, dy, dz, 
respectively). 

b) Prove that in the case of the gravitational vector field, this work does not 
depend on the path and that it is equal to ...? 


4. Consider the following problem about the flux of a vector field. 


a) One has the vector field V (for instance, the vector field velocity of some 
current) on the domain D € R?. Write a formula for the calculation of the flux of 
the vector field V through the oriented surface $ = 2 Cc D asan integral of the first 
type and as an integral of the second type (i.e., in terms of do and dy A dz, dz A dx, 
dx A dy respectively). 

b) Consider a convex polyhedral domain D C R?. On each of its faces is con- 
structed a vector pointing toward the exterior normal direction with magnitude equal 
to the area of the corresponding side. Physics states that the sum of these vectors is 
equal to zero (otherwise, we could build a perpetual motion device). Mathematics 
agrees. Prove this fact. 

c) Deduce Archimedes’s law by a direct computation (calculate the buoyancy 
force acting on a submerged body in a bathtub completely filled with water, for 
example, as the resulting pressure on the surface of the body). 


© Springer-Verlag Berlin Heidelberg 2016 645 
V.A. Zorich, Mathematical Analysis IT, Universitext, 
DOI 10.1007/978-3-662-48993-2 


Appendix A 
Series as a Tool 
(Introductory Lecture) 


When a geological deposit is discovered, it is explored and then exploited. In math- 
ematics, it is also like that. Axiomatics and useful formalisms arise as the result of 
solving concrete questions and problems. They do not fall down from the sky, as it 
seems to inexperienced students when everything starts with axioms. 

This course is largely dedicated to series, i.e., basically limits of sequences. We 
shall give at least an initial idea of how and where this tool works, in order to con- 
vince ourselves that the study of this remarkably effective machinery, namely the 
theory of series, does not reduce to the abstract study of the convergence of series 
(the existence of a limit). 


A.1 Getting Ready 


A.1.1 The Small Bug on the Rubber Rope 


(Problem proposed by the academician L.B. Okun to the academician A.D. Sakha- 
rov.)! 


Problem 1 You hold one end of a | km long rubber rope. A small bug crawls toward 
you from the other end, which is fixed, with a speed of | cm/s. As soon as it crawls 
one centimeter, you stretch the rubber rope another kilometer every time. Does the 
insect ever reach your hand? And if it does, how long will it take? 


'Martin Gardner in his book Time Travel and Other Mathematical Bewilderments (New York: 
W. H. Freeman & Company, 1987, English, p. 295) writes, “This delightful problem, which has 
the flavor of a Zeno paradox, was devised by Denys Wilquin of New Caledonia. It appeared first in 
December 1972 in Pierre Berloquin’s lively puzzle column in the French monthly Science et Vie.” 
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A.1.2 Integral and Estimation of Sums 


After some thinking, it may occur to you that the following sum might be useful in 
finding the answer S,, = L+5t4htec4+ i. 


Problem 2 Recall the integral, and show that S, — 1 < ne ic i dx < Sy= 1s 


A.1.3 From Monkeys to Doctors of Science Altogether in 10° Years 


Littlewood in his famous book Littlewood’s Miscellany, speaking about large num- 

bers, wrote that 10° years is the time needed to convert monkeys into doctors of 
: 2 

science. 


Problem 3 Would the little bug arrive in time for the thesis defense or at least before 
the end of the universe? 


A.2 The Exponential Function 


A.2.1 Power Series Expansion of the Functions exp, sin, cos 
According to Taylor’s formula with remainder in Lagrange’s form, one has 
x 1 1 2 1 n 
e=1l+—x+=x°4+---+—x"+7,(0), 

1! 2! n! 


where r(x) = awe -x"t1 and |é| < |x|; 


1 2 1 4 (=1)" 2n 
a ape OE pe 


COS X = 


+ ron(x), 


where 2p (x) = ee cos(& + 3 (2n + 1))x7"*" and |&| < |x|; 


sinx =x x? +—x aie cy ent 
— 3! 5! (2n + 1)! 


+ ran+i(X), 


where ran+41(%) = aaa sin(E + 5(2n + 2))x?"** and |&| < |x|. Since for every 
fixed value x € R, the remainder in each of the above formulas clearly tends to zero 


?John E. Littlewood, Littlewood’s Miscellany. Cambridge: Cambridge University Press, 1986, En- 
glish, p. 212. 
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as n —> OO, we can write 


ie 1 1 1 1 
— 2 3 4 5 eee —. n eee 
i 
_ 1 2 1 4 (Ay 2n 
cosx = | ha + a seep oa ogee eae 
Das «hws Sa 
Bye angie al ean 


A.2.2 Exit to the Complex Domain and Euler’s Formula 


We substitute x for the complex number ix in the right-hand side of the first of these 
equalities. Then, after some simple arithmetic manipulations, we obtain Euler’s out- 
standing relationship 


e!* =cosx +isinx. 
Setting x = , we find that e’* + 1 = 0. This is the famous equation connecting 
the fundamental constants of mathematics: e from analysis, i from algebra, a from 
geometry, | from arithmetic, and 0 from logic. 
We defined the function exp for purely imaginary values of the argument and 


obtained Euler’s formula e/* = cosx +i sinx, from which, clearly, it also follows 
that 


cos x = (e" +e") and sinx = x(e" - ein): 


A.2.3 The Exponential Function as a Limit 


We know that (1 + *)" —> e* as n > oo for x ER. It is natural to assume that 
e& = limy+o(1 + ees where now z = x + iy is an arbitrary complex number. 
A computation of this limit gives e* = e*(cos y +isiny). 


Problem 4 Verify this and obtain a formula for cos z and sin z. 


A.2.4 Multiplication of Series and the Basic Property 
of the Exponential Function 


The expression e* = e*(cos y + isiny) for e*t” can be naturally obtained from 
the relation e*t’” = e*e!” if it is valid for complex values of the argument of the 
function exp. 
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We shall prove this by direct multiplication. Let u and v be complex numbers. 
Setting e” := )-29 qué and e” := 0° _y Ju” we find that 


we-(St) (Ete) EE 


k=0 nee k=0 m=0 
ioe) 

= 5 bs. a aD uty ae 
n=0n=k+m 


We used here the fact that )°,_-.4.m pguky™ = (u+v)", provided that wv = vu. 


A.2.5 Exponential of a Matrix and the Role of Commutativity 
What happens if in the expression 


1 1 
A? Bie rides , 


1 
AL {+ qo Ton 


1 
we consider A a square matrix, and | is the identity matrix of the same size? For 
example, if A is the identity matrix, then it is easy to check that e4 turns out to be a 
diagonal matrix, with elements e on the main diagonal. 


Problem 5 a) Calculate exp A for the following matrices A: 


(6): (© A) Cras Go) (6 0): 


b) Let A; and A> be the last two matrices of order two. Find e41, e42 and check 
that e4! . e42 4 e41+42, What is going on here? 

c) Show that e4 =7+tA+o(t), fort > 0. 

d) Check that det(J + tA) = 1+1¢- (trA) + o(t), where tr A is the trace of the 
square matrix A. 

e) Prove the important relationship dete4 = e 


ooo 


1 
0 
0 


oro 


trA 


A.2.6 Exponential of Operators and Taylor’s Formula 


Let P(x) be a polynomial and A = + the differentiation operator. Then (A P)(x) = 
Gr) = Pa). 
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Problem 6 a) Check that the relation exp(t) P(x) = P(x +f) is what you know 
as Taylor’s formula. 

b) By the way, how many terms of the series e* do you have to consider in order 
to obtain a polynomial that allows you to calculate e* on the interval [—3, 5] with 
an accuracy up to 1077? 


A.3 Newton’s Binomial 
A.3.1 Expansion in Power Series of the Function (1 + x)” 


Newton knew the validity, for every natural number a, of the formula for the bino- 
mial expansion 


-1 —1)---(a— 1 
(tx) 14 Sep MEO 4 OO ) ae n+ Vie. 


and then he remarked that this formula remains valid for arbitrary a, but the number 
of terms in the sum might be infinite. 

For instance, (1+x)7)=1—x+x?-—x°4--- if |x| <1. 
A.3.2 Integration of a Series and Expansion of \In(1 + x) 


By integrating the last series over the interval [0, x], we find that 


eee. 
MCA) eee was —--+ for |x| <1. 


A.3.3 Expansion of the Functions (1 + x”)~! and arctan x 


Analogously, we write the expansion (1 + x7)7! = 1 — x? +.x4— x°4+.---, we 
integrate its terms over the interval [0, x], and we obtain 


t eg? 
arctanx =x — =x” +—=x° --:- 
3 5 
If we set x = 1, this expansion seems to imply that F=1—f+45—-F+--. 


Perhaps this is true (and certainly it is), but we have the feeling that we are al- 
ready going beyond the limits of what is permitted. The following example will only 
reinforce our concerns. 
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A.3.4 Expansion of (1+ x)~! and Computing Curiosities 


For x = 1, the expansion (1+ x)! =1—x+x?—x3+.--- leads to the equality 
s=1-14+1-14+---. 

By grouping terms, we can obtain 5 =(1-—1)+(-—1)+---=0 and we can 
obtain 5 =1+(-1+1)+(-14+)+--=1. 

After this, it is necessary to question almost everything that we have done so 
successfully and nonchalantly by multiplying the infinite sums (series), rearranging 
and grouping their terms, and integrating them. All this must obviously be clarified. 
We shall do it soon, but before that, we mention yet another area where series are 
commonly used. 


A.4 Solution of Differential Equations 
A.4.1 Method of Undetermined Coefficients 


Consider the simplest equation x + x = 0 of harmonic oscillations. We shall look for 
the solution as a series x(t) = ag + ayt + ant? +---, Substituting the series into the 
equation, grouping the terms with equal powers of f, and equating the coefficients 
with the same powers in ¢ on both sides of the equation, we obtain an infinite system 
of equations: 


2a2 + ap = 0, 2-3a3 +a, =0, 3-4a4+a.=0, 


If the initial conditions x(0) = xq and x’(0) = vo are given, then from the series 
x(t) =ag tat tant? +--+, and x/(t) =a, + 2ant +---, we find that ag = xo and 
a, = vo. If we know apo and aj, we can find successively and uniquely the remaining 
coefficients of the expansion. 

For example, if x(0) = 0 and x’(0) = 1, then 


= Diy, bog we 
iS aa A + 5! —-+-=sinft, 
and if x(0) = 1 and x’(0) = 0, then 


1, 14 
SS al a rte + af —-++-=cost. 


A.4.2 Use of the Exponential Function 


What happens if the solution that we are looking for has the form x(t) = e*’? Then 
¥ +x =e (42 — 1) =0, and therefore A? + 1 = O, ie, A= i or A = —i. But what 
are these strange complex oscillations x(t) = e x(t) =e", and x(t) =cyje" + 
ce! ? 
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Problem 7 Analyze the situation and solve the problem, for example, if x(0) = 0 
and x’(0) = 1 or if x(0) = 1 and x’(0) = 0. Recall Euler’s formula and compare 
your results with those obtained above. 


A.5 The General Idea About Approximation and Expansion 


A.5.1 The Meaning of a Positional Number System. Irrational 
Numbers 


Recall the usual representation of the number z = 3.1415926... or in general a dec- 
imal expansion ag.a1a2q3 ...: this is the sum ao10° +a; 107! +.a710~2 +.431077 + 


We know that a finite expansion corresponds to a rational number, and the repre- 
sentation of an irrational number requires an infinite number of decimal digits, and 
therefore requires the study of an infinite number of terms and infinite sums, i.e., 
series. 

If we truncate a series at some point, we get a rational number. We usually work 
such numbers. What happened here? We have simplified the object, allowing some 
error. This means that we are approximating a complex object (an irrational number 
in this case) through some other objects (the rational numbers here), while allowing 
some error, which we call the degree of precision of the approximation. An im- 
provement in the precision leads to the complication of the object that we use as an 
approximation. A compromise has to be found depending on the concrete circum- 
stances. 


A.5.2 Expansion of a Vector in a Basis and Some Analogies 
with Series 


In linear algebra and in geometry, we decompose vectors in terms of a basis. For 
mathematical analysis, the traditional representation 


1 1 
f@)=fO+ pf Ox + xf" Ox? rae 


actually means the same thing if we consider that the basis is the set of functions 
€, =x". This is the Taylor series of the function f at the point xg = 0. 

Analogously, if some periodic signal or process f(t) is subjected to spectral anal- 
ysis, then one is interested in its decomposition f(t) = )-°2.9 an cosnt + by sinnt 
into the simplest harmonic oscillations. Such series are called classical (or trigono- 
metric) Fourier series. 

What is new in this situation, in comparison with that in linear algebra, is that we 
consider here an infinite sum, which is understood as the limit of finite sums. 
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Thus in the space of our objects one must define the concept of proximity be- 
tween the objects, in addition to the structure of a linear space, allowing one to be 
able to consider the limit of the sequence of the objects themselves or their sum. 


A.5.3 Distance 


The proximity between objects is determined by the presence of a particular con- 
cept, the concept of neighborhood of an object (neighborhood of a point in the 
space). This is the same as specifying a topology in the space. In topological spaces 
it is possible to speak about limits and continuity. 

If in a space, a distance between objects, i.e., the points of the space, is somehow 
introduced, then the neighborhoods of a point are automatically defined, and even 
more specifically, the 6-neighborhoods of a point. 

The distance between points of the same space can be measured in different 
ways. For example, the distance between two continuous functions over an interval 
can be measured by the maximum of the absolute value of the difference between 
the values of the functions on this interval (uniform metric), and it is also possible to 
measure it by the integral of the absolute value of the difference of the functions over 
this interval (integral metric). The choice of the metric is dictated by the problem 
under consideration. 


Appendix B 

Change of Variables in Multiple Integrals 
(Deduction and First Discussion of the Change 
of Variables Formula)! 


B.1 Formulation of the Problem and a Heuristic Derivation 
of the Change of Variables Formula 


By studying the integral in the one-dimensional case, at some moment we obtained 
an important change of variables formula for such an integral. Our task now is to 
find a change of variables formula in the general case. We formulate the problem 
more precisely. 

Let D, be a set in R”, f an integrable function on D,, and g: D; > D, a 
mapping t +> g(t) from the set D, C R” to D,. The question is, what is the law, 
assuming that we know f and ¢, that allows us to find a function w on D; such that 
we have the equality 


/ fixyde = | wie)dr, 
Dy D; 


which reduces the computation of an integral over D, to an integral over D,? 

We suppose first that D; is an n-dimensional interval J C R” and gy: I > D, 
is a diffeomorphic mapping from J onto D,. To every partition of the interval J 
into subintervals [,, J2,..., 7% corresponds a partition of D, into subsets (Jj), 
i=1,...,k. If all these sets are measurable and intersect pairwise only on sets 
of measure zero, then by the additivity of the integral, 


k 
oe / (x) dx. (B.1) 
[76 ° d, ae 


If the function f is continuous on D,., then the mean value theorem implies 


f(x)dx = fE)u(ei), 


gi) 


‘Fragment of a lecture with an alternative and independent proof of the change of variables for- 
mula. 
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where &; € g(/;). Since f(&;) = f(¢(z;)), with tT = gy '(&), then it remains for us 
to link w(gU;)) with wi) = [Lil 

If g is a linear transform, then g(/;) is a parallelepiped, whose volume we know 
from analytical geometry and algebra and is equal to |detg’|u(J;). But a diffeo- 
morphism is locally almost a linear map. Therefore, if the size of the intervals 
J, is sufficiently small, then it can be assumed, with a small relative error, that 
L(pCj)) © | dety’(t;)|u(U;) (it is possible to prove that with a proper choice of 
the point t; € 7;, one has the exact equality). In this way, 


k k 
2 fey de~ | f(oCed) |deto' Ce) {Til (B.2) 
t=! 


i=1 ei 


However, on the right-hand side of this approximate equality there is the integral 
sum of the function f((t))| det g’(t)| over the interval 7, corresponding to the par- 
tition P of this interval with marked points rt. In the limit A(P) — 0, from equa- 
tions (B.1) and (B.2) we get 


faye = ff f (g@)|detg'()| de. (B.3) 


Dx 


This is the required formula together with its explanation. Note that it is possible 
to justify rigorously each step of this deduction, which led us to the formula. Strictly 
speaking, we need to prove only the validity of the last passage to the limit, that the 
integral on the right-hand side of (B.3) exists, and also to explain the approximation 
u(y) © | det g'(ti)| + il 

Let us do it. 


B.2 Some Properties of Smooth Mappings and Diffeomorphisms 


a) Recall that a smooth mapping g from a closed and bounded interval 7 Cc R” 
(or from any other convex compact subset) is a Lipschitz function. This follows 
from the mean value theorem and the boundedness of gy’ (because of the continuity) 
over a compact set 


lea) - et) < SY) |e’ @|-le-nl<Lip-nl. (B.4) 


te[t1 ,t2] 


b) Thus, the distance between the images of the points under the mapping » 
cannot exceed L times the distance between the points. 

For instance, if some subset EF C J has diameter d, then the diameter of its image 
y(E) is not more than Ld, and the set y(E) can be covered with (n-dimensional) 
cubes with edges of size Ld and volume (Ld)". 

Thus if E is a cube with edges of size 5 and volume 6”, then its image is covered 
by a standard coordinate cube of volume (L./n5)". 
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c) It follows from this that the image under smooth mappings of O-measure sets 
have also measure 0 (in the sense of n-dimensional objects). [After all, in the defini- 
tion of a set of measure zero, it is possible to consider coverings by cubes, instead of 
a covering with general n-dimensional intervals, i.e., “rectangular parallelepipeds”’, 
as we can easily see.] 

If a smooth mapping g : D; — D,. has also an inverse smooth mapping g~ 
D,, — Dy, i.e., if g is a diffeomorphism, then it is clear that the pre-image of a set 
with measure zero also has measure zero. 

d) Since under a diffeomorphism, the Jacobian of the mapping det’ is every- 
where different from zero, and the mapping itself is bijective, then (due to the in- 
verse function theorem) the interior points of any set under such a mapping are 
transformed into the interior points of the image of this set, and the boundary points 
are transformed into the boundary points of the image. 

Recall the definition of an admissible (Jordan-measurable) set, as a bounded set 
whose boundary set has measure zero; thus we can conclude that under diffeomor- 
phisms, the image of a measurable set is again a measurable set. 

(This is also true for any smooth mapping. However, for diffeomorphisms it is 
even true that the pre-image of a measurable set is also a measurable set.) 

e) This latter in particular means that if g : D; > Dy, is a diffeomorphism, then 
from the existence of the integral on the left-hand side of formula (B.3) there follows 
(based on Lebesgue’s criterion) the existence of the integral on the right-hand side. 


1. 


B.3 Relation Between the Measures of the Image and the 
Pre-image Under Diffeomorphisms 


We shall show that if g : J > g(J) is a diffeomorphism, then 
w(t) = | der’@ar, (B.S) 
I 


under the assumption that the integrand det y’ is positive. 
Hence, by the mean value theorem, in particular, we find that there is a point 
t € I such that 


u(p(1)) = dety’(r)ITI. (B.6) 


Formula (B.5) is actually a particular case of (B.3), when f = 1. 

For linear mappings, this formula is already known, although perhaps without 
discussing those details related to the fact that it is valid (for linear maps) not only 
for simple parallelepipeds but for all measurable sets. Let us clarify this. We know 
that a linear map is the composite of elementary linear mappings, which, up to a 
possible permutation of a pair of coordinates, are reduced to a change in only one 
of these coordinates: multiplying or adding a number of any one of the coordinates 
to another one. Fubini’s theorem allows us to determine that in the first case, the 
volume of any measurable set is multiplied by the same factor that multiplies the 


658 B_ Change of Variables in Multiple Integrals 


coordinate (more precisely, its absolute value if we consider nonoriented volume). 
In the second case, although the face changes, its volume remains the same, since 
the corresponding one-dimensional section only moves, keeping its linear measure. 
Finally, a permutation of a pair of coordinates changes the orientation of the spatial 
frame (the determinant of such a linear transformation is —1), but it does not change 
the nonoriented volume of the face. (In the language of Fubini’s theorem, this is just 
a change in the order of two integrations.) 

It now remains to recall that the determinant of the composition of linear map- 
pings is the product of the determinants of the factors. 

Thus, considering that for linear and affine mappings the formula (B.5) is already 
established, we prove it for an arbitrary diffeomorphism with positive Jacobian. 


a) We use again the finite-increment theorem, but now to estimate the possible 
deviation of the mapping g : J > (J) from the affine mapping t > A(t) = g(a) + 
y’(a)(t — a), where t is a variable, and a is a fixed point in the interval 7. The 
mapping A: J — A(J) is simply the linear part of the Taylor expansion of the 
function @ at the point a € I. 

If we apply the finite-increment (mean value) theorem to the function t > g(t) — 
y'(a)(t — a), we obtain 


l(t) — g(a) — g'(a)t —a)| < sup lle") —¢'(a)|| -|t —al. (B.7) 
TElLa,t 


Given the uniform continuity of the continuous function g’ on the compact set /, 
from equation (B.7) we conclude that there is a nonnegative function 6 > (6), 
tending to zero as 6 — +0, such that for any two points t,a € 1 CR", 


It —a| < /nd => |o(t)- AW| = |oO -9@—-¢'@(t—a)| < €(5)5. (B.8) 


b) Now we go back to the proof of formula (B.5). First we shall carry out a small 
technical simplification: we shall assume that the lengths of the edges of the paral- 
lelepiped J are commensurable and that therefore, they can be divided into equal 
cubes {/} with arbitrarily small (as necessary) edges 6; = 6 and volume 67 = 6”, 
ie., J =, & and |J| = 0; il =, 67. 

In every cube /;, we fix a point a;, we build the corresponding affine mapping 
Aj(t) = o(a;) — g'(a;)(t — aj), we consider the image A;(0/;) of the cube’s J; 
boundary 0/7; under the mapping A;, and we consider the ¢(6)d-neighborhood of 
this image, which we denote by A;. By (B.8), the image g(0/;) of the boundary 0/; 
of the cube J; lies in A; under the diffeomorphism g. Thus, one has the following 
inclusions and inequalities: 


Aj (ij) \ Ai C GU) C Aj Ui) U Aj, 
|Ai(i)| — |Ail < |eU)| < |Ai)| + |Ail- 


When we take the sum over all indices, we have 


yA] — do 14: < |eD| = dSleda| s Doar] + Doli. B.9) 


L L 


l 
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As 6 > +0, 
S > |Ai i) | = Do dety'(ai)|Li| > [ovw'oar, 
: 5 I 
L I 


Therefore, to prove formula (B.5) in our case, it remains to verify that ; |A;| > 0 
if 5 > +0. 

c) We estimate from above the volume |A;|, based on the estimates (B.4) and 
(B.8). According to (B.4), the edges of the parallelepiped A; (J;) have length not 
greater than Ld, where 6 = 6; is the length of the edge of a cube J;. Thus the 
(n — 1)-dimensional “area” of any of the 2” faces of the parallelepiped A; (/;) is 
not greater than (L5)"—!. We take an €(6)d-neighborhood of such a face. Its vol- 
ume is estimated with the value (2+ 2)e(5)5(L6)"—!, where the second 2 appearing 
in the formula is the absorption contribution of the rounded parts of this neighbor- 
hood, occurring near the boundary of the face. In this way, |A;| < 2n-4L"~'e(6)6"; 
therefore, 


L 


So Ail < 8nL""! SY" 6(6)87 = 8nL"~'e(8) IT], 
i 


and we see that )>; |A;| > 0 for 6 > +0. 

d) The estimated values for |A;| show at the same time that no matter how ar- 
bitrarily small the reduction of the edges of the original interval J becomes, which 
one might need in order to obtain their commensurability, in the limit this does not 
affect the result. 


B.4 Some Examples, Remarks, and Generalizations 


Thus formula (B.3) for the case D; = 7 and a continuous function f is already 
proved. We shall consider and discuss some examples. These will show at the same 
time that in fact, we have already proved formula (B.3) not only for the case D; = I 
and not only for a continuous function f. 


a) Negligible sets. As it is used in practice, replacing variables or the use of a 
coordinate transformation formula sometimes has several special features (for ex- 
ample, somewhere there might be a violation of mutual uniqueness, vanishing of 
the Jacobian, or lack of differentiability). Typically, these special features occur on 
sets of measure zero, and are therefore relatively easy to overcome. 

For example, if you need to go from an integral over a circle to an integral over 
a rectangle, we often make the change of variables 


xX =Prcosg, y=rsing. (B.10) 


These are the well-known formulas for the transition from polar coordinates to 
Cartesian coordinates in the plane. The rectangle J = {(r, g) € R2 |O0<r<R,0< 
~ < 2m} under this mapping is transformed into the circle K = {(x, y) € R? | 
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x? + y? < R7}. This mapping is smooth, but it is not a diffeomorphism: the whole 
side of the rectangle J on which r = 0 is transformed under this mapping into the 
point (0, 0); the images of the points (7, 0) and (r, 277) coincide. However, if we con- 
sider, for example, the sets J \ 0J and K \ E, where E is the union of the boundary 
0K of the circle K and the radius going to the point (0, R), then the restriction of 
the mapping (B.10) to the domain J \ d/ is a diffeomorphism with the set K \ E. 
Therefore, if instead of the rectangle J, we take a slightly smaller rectangle J; lying 
strictly in the interior of 7, then we can apply formula (B.10) to this rectangle /; 
and its image Ks. And then, exhausting the rectangle J with such rectangles Js and 
noticing that their images exhaust the circle K, that |Js| > |Z| and |Ks| > |K|, in 
the limit we obtain formula (B.3) applied to the original pair K, /. 

This applies, of course, to the general polar (spherical) coordinates system in R”. 

We shall now develop these observations. 

b) Exhaustions and limit transitions. We define an exhaustion of a set E C R” 
to be a sequence of measurable sets {£,,} such that E, C En, C E for everyn EN 
and | J) En= £. 


Lemma 1 /f {E,,} is an exhaustion of a measurable set E, then 


a) limp—+oo (En) = ME); 
b) for every function f € R(E), one has f\z, € R(En) and 


tim, [ fodx= fi roar, 
noo Jr E 


Proof a) Since Ey, C Ens; C E, then m(En) < w(Ensi1) < WCE) and 
limy—+oo U(En) < “(E). For proving the equality in a), we shall show that the in- 
equality limp—+oo (En) => WE) also holds. 

The boundary 0£ of the set E is compact and has measure zero. Therefore, it can 
be covered with a finite number of open intervals such that the sum of their volumes 
is less than e for a given ¢ > 0. Let A be the union of these open intervals. Then the 
set O = EU A is open in R”; by construction, O contains the closure E of the set 
E;and 1(O) < w(E) + WA) < we) +6. 

For every set E,, of the exhaustion {E,} we repeat the construction above with 
En = €/2”. We obtain then a sequence of open sets O, = E, U A, such that Ep, C 
On, HCOn) < (En) + M(An) < M(En) + En and (ei On D Uri E, DE: _ 

The system of open sets A, O;, O2,... is an open cover of the compact set E. 

Let A, O1, Or,..., Ox be a finite open subcover of the compact set E. Since 
E, C Er C-:-C Ex, the sets A, Aj,..., Ax, Ex are also a cover of E, and then 


WCE) < w(E) + (A) + W(Al) +++ + (Ag) < (Ex) + 20. 


It follows from this that w(E) < limy+o0 W(En). 

b) The fact that f|z, € R(En) is known to us, and it follows from Lebesgue’s 
criterion for the existence of the integral over a measurable set. By the hypothe- 
sis f € R(E), there exists a constant M such that | f(x)| < M over E. From the 
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additivity of the integral and the general estimates for the integral, we get 


[ terav- f f(x) dx i f(x) dx 
E i" E\En 


Hence, taking into account what we proved in a), we conclude that assertion b) 
holds. 


< MuUlE\ E,). 


The additivity of the integral and the possibility of exhausting the domain of 
integration with the domains where the change of variables formula works (i.e., 
it is directly applicable) allow us to apply the formula to the original domain. In 
general, the idea of exhaustion lies at the heart of many constructions in analysis. In 
particular, it is fundamental in the definition of improper integrals. 


Appendix C 

Multidimensional Geometry and Functions 

of a Very Large Number of Variables 
(Concentration of Measures and Laws of Large 
Numbers) 


C.1 An Observation 


Almost the entire volume of a multidimensional body is concentrated in a small 
neighborhood of the boundary of the body. 


Problem 1 a) Check this in the examples of the cube and the ball. Show that if we 
remove the shell with thickness 1 cm from a 1000-dimensional watermelon with 1 
meter radius, then there remains less than a thousandth of the original watermelon. 

b) If we project the sphere §”~!(r) C R” orthogonally onto a hyperplane passing 
through the center of the sphere, then we obtain a ball (double covered) with the 
same dimension n — | and the same radius r. Considering what we obtain above, 
notice (still on a qualitative level), that almost all the area of the sphere S” —l(r) for 
n > | is concentrated in a small neighborhood of the equator, the intersection of the 
sphere with the former hyperplane. 


C.2 Sphere and Random Vectors 


Problem 2 a) The sphere S” —l(r) with radius r and center at the origin of the n- 
dimensional Euclidean space R” is projected orthogonally onto a coordinate axis. 
We get the interval [—r, 7]. We fix another interval [a,b] c [—-r,r]. Let S[a, b] be 


the area of the part as (r) of the sphere S”~!(r) that is projected onto the interval 
S[a,b] 


S[—r,r]? 
point on the sphere will be on the layer Sra (r) over the interval [a, b], considering 
that the points are uniformly distributed over the sphere. 


a,b] 


[a, b]. Find the quotient 


i.e., the probability Pr,[a, b] that arandomly chosen 


Answer: 
b 2y 3 
(1 —(x/r)*) 2 dx 
Pry[a, b] = la b n-3 . 
2 
fA -G@/ryy? dx 
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b) Let 6 € (0, 1) and [a, b] = [6r, r]. Show that as n > ov, 


1 
Pr, [6r, 7] ~ en 38m 
6 270n 


Hint: You can use Laplace’s method for obtaining asymptotics of the integral over a 
large parameter. 

c) The result obtained in b) implies that the vast majority of the area of a multi- 
dimensional sphere is concentrated in a small neighborhood of the equatorial plane, 
in the layer ae sr] (") Over the interval [—6dr, dr]. 

Deduce from this that if we take independently and randomly a pair of vectors 
in R”, then for n > 1, it is very likely that they will be almost orthogonal, i.e., their 
scalar product will be close to zero. Estimate the probability that the scalar product 
is greater than ¢ > 0 and calculate its variance for n > 1. 

d) Prove, based on the result proved in a), that for r = 0 ,/n and n > oo, one has 


1 fe at 
Pr, [a, b] > / e 2? dx. 
201 O Ja 

e) Considering the result obtained in b), prove now Gauss’s law on the distribu- 
tion of measurement errors and Maxwell’s laws on the distribution of gas molecules 
according to speed and energy (considering in the first case that the observations 
are independent and their mean square stabilizes as the number of observations in- 
creases, and in the second case considering that the gas is homogeneous and that the 
total energy of the molecules in a portion of the gas is proportional to the number of 
molecules in this portion). 


C.3 Multidimensional Sphere, Law of Large Numbers, 
and Central Limit Theorem 


By solving this problem, you will discover the following fact, important in many 
aspects and manifested in many areas (for example, in statistical physics). 

Let S” be the unit sphere in the Euclidean space R’”*! with a very large dimen- 
sion m+ 1. Suppose also that we are given a sufficiently regular real-valued function 
on the sphere (for example, from a fixed Lipschitz class). We take randomly and in- 
dependently two points and calculate the value of the function at these points. With 
a high probability, the values will almost coincide and they will be close to a certain 
number Mf. 

(This, still hypothetical, number My is called the median value of the function 
or function median. It is also called the average value of the function in the sense 
of Lévy.! The motivation for these terms will soon be clear, together with a precise 
definition of the number M ;.) 


Ip. Lévy (1886-1971) — famous French mathematician, student of J. Hadamard. 
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We introduce some notation and conventions. We define the distance between 
two points on the sphere S” C R’”t!, understood in terms of its geodesic metric p. 
We denote by A; a 5-neighborhood in S” of the set A C S”. We replace the stan- 
dard mass of the sphere with a uniformly distributed probability measure J, 1.e., 
u(S™) = 1. 

We have the following assertion proved by Paul Lévy, commonly called Lévy’s 
isoperimetric inequality. 

For every 0 <a <1 and 6 > 0, there exists min{u(As) | A C S”, u(A) = a}, 
and it is attained on the spherical cap A® with measure a. 

Here A° = B(r), where B(r) = B(xo,r) = {x € S” | p(xo,x) < r} and 
U(B(r)) =a. 


Problem 3 a) For a = 1/2, ie., when A° is a hemisphere, obtain the following 
result: 

If the subset A C S"*! is such that (A) > 1/2, then (As) > 1— Ja /Be-*"/?, 
(If n — oo, we can change here ./7/8 for 1/2.) 

b) We denote by M¢ the number such that 


uf{x eS" | f(x) <My}>1/2 and pfxeS"| f(x) >My} > 1/2. 


It is called the median or average value in the sense of Lévy of the function f : 
S” — R. (If the M -level of the function f on the sphere has measure zero, then 
the measure of each of these two sets mentioned above will be equal to exactly half 
of the jz-area of the sphere S”.) 

Obtain the following lemma due to Lévy: 

If f €C(S"*!) and A= {x € S"*! | f(x) = My}, then w(As) > 1 — /a/2 x 
ene n/2. 

c) Let w¢ (6) = sup{| f(x) — f(y)| | oe, y) < 5} be the modulus of continuity of 
the function f . 

The values of the function f on the set As are close to My. More precisely, if 
w (5) < €, then | f(x) — My| < € on As. Thus Lévy’s lemma shows that “good” 
functions are actually almost constant in almost their entire domain of definition S$” 
when the dimension m is very large. 

Considering that f € Lip(S”~!, R) and L is the Lipschitz constant of the func- 
tion f, estimate the probability Pr{| f(x) — My| > €} and the dispersion value 
|f(x) — My| forn > 1. 

d) Obtain, as above, estimates in the case that the function f is not defined on 
the unit sphere but in the sphere $”~!(r) with radius r. 

e) If f is a smooth function, then we can clearly take the maximum modulus 
of its gradient as the Lipschitz constant L. For example, the linear function S, = 
i (x1 +---+x,) has L= Ly, = Tr Suppose that we have a sequence of Lipschitz 


functions f, € Lip(S”~! (rj), R), for which Ly = O(F) and ry, = Jn. 
Estimate Pr{|fn(x) — My,| > ¢} and the dispersion value | f,(x) — My,| for 


n>. 
In particular, for f;, = S, deduce the standard law of large numbers. 
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f) Let f, = x; +--+: +2X,. The levels of this function are hyperplanes in R” 
orthogonal to the vector (1,..., 1). The same can be said about the linear function 
n= writs 1+-:-+x,), with the only difference that under the movement from 
the origin in the direction of (1,..., 1), its values coincide with the distances to the 
origin. For this reason, its values are distributed on the sphere S”—!(r,) exactly as 
they are on each of the coordinates. 

Using this discussion and the result of Problem 2.d), setting r, = o./n, obtain 
your own version of the central limit theorem. 


C.4 Multidimensional Intervals (Multidimensional Cubes) 


Problem 4 a) Let J be the standard unit interval [0, 1] of the real line R, and 7” the 
standard n-dimensional interval in R”, usually called the n-dimensional unit cube. 
This is a unit of volume in R", but its diameter ./n for n >> 1 is extremely huge. 
Thus, even Lipschitz functions on J” with Lipschitz constant L can have values 
spread within L./n. 

Yet here, as in the above case of a sphere, there is a phenomenon of asymptotic 
stabilization (concentration) of values of such functions in the limit n > oo. 

Now, try to find the proper formulations of the problem and study the phe- 
nomenon, up to the level of your ability (then check Sect. C.5 of this appendix). 

b) Suppose we have n independent random variables x;, taking values in the 
unit interval [0, 1] and having distribution probabilities p; (x), which are uniformly 
separated from zero (in particular, all p;(x) may coincide). Then as 1 grows, the 
large majority of the random points (x1,...,%») € J” will lie in close proximity to 
the border of the cube. 

Explain this, and considering the result in a), obtain your own general law of 
large numbers. 

c) Show with an example that if the probability density of the random variables 
in b) is concentrated in the vertices of the cube as point masses, then the asymptotic 
stabilization of values for Lipschitz functions in the limit n + oo may not occur. 

d) We noted above that although the volume of the cube 7” in R” is equal to 1, 
its diameter ./n increases for n >> 1, which creates difficulties. However, we have 
the following useful compensating observation: if each of two subsets A and B of 
the cube 7” has measure greater than an arbitrarily small fixed positive number e, 
then the distance between A and B is bounded from above by a constant depending 
only on ¢ (and not depending on 7). Prove this, and use this result if you need it. 

e) Calculate the volume of the unit ball in R” and show that the radius of the ball 
with volume one increases as \/n/(27e) as n > 00. Go back to Sects. C.1 and C.2 
and convince yourself again that the normal distribution and the laws related to it 
are closely linked in the geometric aspect with a simple multidimensional object, 
namely with the ball of unit volume. 
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C.5 Gaussian Measures and Their Concentration 


Problem 5 a) We mentioned in Sect. C.2 of this appendix the isoperimetric inequal- 
ity on the sphere, in connection with the discussion of the observed stabilization of 
values (constancy) of regular functions on the multidimensional sphere. The same 
problem about minimizing the measure of a 5-blowup of a set is important, and for 
the same reason it is also interesting in relation to other spaces that serve as natural 
domains for the relevant functions. 

For example, in the case of the Gaussian probability measures defined by the 
normal probability distribution in the standard Euclidean space IR”, the answer is 
also known (obtained by Borel). In this case, the extreme domain (with the fixed 
initial value of the Gaussian measure and a 6-blowup, understood in the sense of the 
Euclidean metric) turns out to be a half-space. 

In particular, if we take the half-space with Gaussian measure 5 and we directly 
calculate the value of the Gaussian measure of the complement in its Euclidean 
5-blowup, then considering Borel’s isoperimetric inequality, we can deduce that for 
any set A having a Gaussian measure 5 in the space R”, the measure of its 6-blowup 
can be estimated from below with w(As3) > 1 — Js, where Js is the integral of the 


density (27)? exp(— 5) of the Gaussian measure of the half-space, given with 
Euclidean distance 6 from the origin. 

An estimate from above of the integral Js, for example, allows us to claim that 
1u(Ag) = 1 — 2exp(—$). Prove this. 

b) This is a rough estimate, but it shows the rapid growth of (A3), with an 
increase of 5, whatever the initial set A of measure 4 1s. 

It is very interesting to notice (and considering the possible transition to infinite- 
dimensional spaces, even quite useful) that the last estimate does not depend on the 
dimension of the space. It may seem that this absence of the dimension is a great 
loss and weakness in the estimates within the context of concentration measures 
discussed and in the stabilization of values of functions of several variables. In fact, 
this estimate even contains the principle of the concentration of a measure on the 
unit sphere of large dimension, discussed above. 

It is enough to prove (prove it) that the main part of the Gaussian probability 
measure of the Euclidean space R” for n >> 1 is concentrated in the vicinity of 
the unit Euclidean sphere of radius ./n. This means that at the intersection of this 
neighborhood with the half-space, which is distant from the origin, the proportion 
of this measure is exponentially small. Therefore, the main part of the measure is 
in this neighborhood of the sphere of radius ,/n, which falls in the layer between 
two close parallel hyperplanes, symmetric with respect to the origin. If now we 
move through a homothety from the sphere of radius ./n to the unit sphere, then we 
obtain the principle of concentration of measure on the unit sphere, which we have 
already discussed (do the necessary calculations). In the statement of this principle, 
the dimension of the space occurs explicitly. This dimension was also present in the 
Gaussian case, but it was hidden in the size ./n of the sphere, and the main part of 
the measure of the whole space is concentrated in a neighborhood of this sphere. 
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C.6 A Little Bit More About the Multidimensional Cube 


In the Euclidean space R” we consider the n-dimensional unit interval (“cube’’) 
n 1 n n i 1 . 
= XS (ae per [Ie]s 5 FHL 2-00 ; 


Its volume is equal to one, although the diameter is ,/n. (Recall that the Euclidean 
ball of volume one in R” has radius of order ./n, as mentioned above.) We shall 
consider the standard probability measure uniformly distributed on the cube J”. 
Let a = (a!,...,a") be a unit vector, and x = (x!,..., x”) an arbitrary point in 
the cube J”. 
The following inequality holds (probability estimate of Bernstein type): 


Pry, | 3 aix! 


i=1 
If we interpret the sum )~_, a'x! as a scalar product (a, x), we notice that this 
can be large (of order ./n) if the vector a is not directed along any edge of the 
cube, but along the main diagonal, mixing all coordinate directions equally. If we 
take a= ( babs wr in the previous estimate, we deduce that the volume of the 


> 1 < 2exp(—617). 


n-dimensional cube J” concentrates, as n increases, in a small neighborhood of the 
hyperplane passing through the origin and orthogonal to the vector (J wanes aa): 
In particular, if we consider a billiard in such a cube as a dynamical system 
(gas) composed with noninteracting particles, then for n >> 1, the large majority of 
particle trajectories will go in a direction nearly perpendicular to the fixed vector 


(Fe His Wie and they are a large part of the time in a neighborhood of the above 
hyperplane. 


C.7 The Coding of a Signal in a Channel with Noise 


We point out in conclusion another area where the functions with a very large num- 
ber of variables also appear naturally and where the principle of concentration of a 
measure is shown and also used substantially. 

We are already used to the digital (discrete) coding and transmission of signals 
(music, images, messages, information) on a communication channel. In this form, 
a message can be thought of as a vector x = (x!,..., x”) in the space R” with a very 
large dimension. The transmission of such messages requires an energy E,, which is 
proportional to ||x||? = |x!|? +---+ |x”|? (like the total kinetic energy of the gas 
molecules, discussed above). If T is the duration of the transmitted message x, then 
P = E/T is the average power required to transfer one character (a coordinate of 
the vector x). If A is the average time required to transfer a single coordinate of the 
vector x, then T=nA and E=nPA. 
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The transmitting and receiving devices are aligned in a such a way that the trans- 
mitter transforms (encodes) the original message to be transmitted in the form of 
the vector x. It sends it over the communication channel, and the receiver, knowing 
the code, decrypts x, transforming it into the form of the original message. 

If we need to transmit M messages Aj,..., Ay of length 7, then it is enough to 
fix n points in the ball of radius VE, agreeing on this selection with the receiving 
end of the communication channel. If in the communication channel there is no in- 
terference, then having received the vector from the agreed set, the receiver decodes 
it correctly into the corresponding message A. 

If in the channel we do have interference (which is often the case), then because 
of the interference, a random vector € = (& ae &") shifts the transmitted vector a, 
and the vector a+ arrives at the receiver, and this vector must be properly decoded. 

If the points a}, ...,@, were chosen in such a way that the balls of radius ||&]| 
with these points as center do not intersect, then an unambiguous deciphering is 
still possible. But if we want to meet this requirement, then we cannot take just 
any points a),...,a@y, and there is a problem of dense packing of spheres. This is 
a difficult problem, whose solution in the present situation can be avoided, as was 
shown by Shannon, given that here the dimension n of the space R” is huge. 

We shall allow ourselves sometimes to make mistakes while interpreting the re- 
ceived message. However, we require the probability of error to be arbitrarily small 
(less than any fixed positive number). 

Shannon showed that even in the presence of random noise (white noise) in the 
communication channel with limited capacities, by choosing a long enough code 
(i.e., for a large value of 7), it is possible to achieve velocities of transmission close 
to the velocities of transmission of information in channels without noise, with an 
arbitrarily small probability of error. 

The geometric idea of Shannon’s theorem is directly related to the characteristics 
discussed above of the distribution measures (volumes) of domains in a space with 
large dimension. Let us explain this. 

Suppose that two identical balls in the space R” intersect. If the received signal 
lies in this intersection, then it is possible to have errors in the interpretation of the 
message sent by the source. But if the probability of falling into such an area is 
considered proportional to the relative volume of the region, then it is natural to 
compare the volume of the intersection of the balls with the volume of a ball. We 
carry out the proper estimations. If the centers of two balls of radius | are separated 
by the distance ¢ (0 < € < 2), then the intersection of these balls is contained in a 
ball of radius ./1 — (e/2) with center in the middle of the segment connecting the 
centers of the original balls. Hence, the ratio between the volume of the intersection 
of the two balls and their own original volume does not exceed (1 — (¢/ 2)7)"/?. It is 
clear now that for every fixed ¢, this value can be made arbitrarily small by choosing 
a sufficiently large value of n. 


Appendix D 
Operators of Field Theory in Curvilinear 
Coordinates 


Introduction 


Almost any book with mathematical problems and even any textbook of mathemat- 
ical analysis states something like the following. “Children, remember”: 
We call the gradient of a function U (u, x, z) the vector 


dU dU ~0U 
grad U := {| —_, —, — ]}. 
ax dy dz 


The curl of a vector field A = (P, Q, R)(x, y, z) is the vector 


(= 00 dP OR OQ =) 
curl A := : 


dy dz’ dz dx’ dx dy 
The divergence of a vector field B = (P, Q, R)(x, y, z) is the function 
dP a OR 
joe 
ax dy Oz 


The fact that this is true only in Cartesian coordinates is not usually discussed, 
as well as what should be done if the coordinate system is different. This is under- 
standable, since the very formulation of this problem already requires some suitable 
definition of these objects. 


D.1 Reminders of Algebra and Geometry 


D.1.1 Bilinear Forms and Their Coordinate Representation 


a. Scalar Product and General Linear Forms 


We shall consider a vector space with a scalar product (, ). We can still consider that 
(,) denotes an arbitrary bilinear form on an n-dimensional vector space X. If we 
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choose a basis of the space &1,..., &,, then the objects of the space (in particular, 
vectors and forms) will have a coordinate representation. We recall the coordinate 
representation of the bilinear form (, ). 

If we take two vectors x = x/&;, y = y/ §; and their decomposition in terms of 
the basis, then we have (x, y) = (x'&, y/&;) = (&, &j)x'y/ = gijx'y/. As usual, 
summation over repeated indices is understood. Thus if a basis of the space is given, 
the choice of values (§;, ;) = g;; completely defines the bilinear form. 

If the form is a scalar product, then a basis is orthogonal if g;; = 0 fori A j. It is 
assumed here that the form is nondegenerate, of course. 


b. Nondegeneracy of Bilinear Forms 


A bilinear form is called nondegenerate if once we fix a value in one of its argu- 
ments, then the bilinear form is identically zero with respect to the other argument 
if and only if the fixed value is zero (the zero vector). 

The nondegeneracy of the form is equivalent to the fact that the determinant of 
the matrix (g;;) is different from zero. Indeed, if the fixed vector x = x! & is such 
that (x, y) =0 with respect to y, then (&;, &j)x! = 0 and gijx! = 0 for every value 
j €{i,...,n}. This homogeneous system of equations has a unique solution (zero) 
if and only if the determinant of the matrix (g;;) of the system is nonzero. 


D.1.2 Correspondence Between Forms and Vectors 


a. 1-Forms in the Presence of 2-Forms and Their Correspondence with Vectors 


If one has a 2-form (, ), then each vector A can be associated with a 1-form, namely 
the linear form (A, x). If the 2-form is nondegenerate, then the correspondence is 
one-to-one. Indeed, if we are given such a linear function a(x) = ajxi (where aj= 
a(&;)) and we want to represent it in the form (A, x), where A = &; A‘, then in 
the coordinates of the vector A we have the system of equations a(€) = (&, &j) A‘, 
j =1,...,n, which is uniquely solvable if the determinant of the matrix (g;;) is 
different from zero. 

Thus, the coordinates of the vector A = Alé; and the coefficients of the 1-form a 
in the same basis {&;} are linked by the mutually inverse relations 


aj= Bij’, At = glaj. 


b. Correspondence Between a Vector and an (” — 1)-Form 


Similarly, if one has a nondegenerate n-form 92, each vector B can be associated 
with an (n — 1)-form, namely the form 22(B,...). 
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We shall deal below with vector fields A, B and carry out this described method 
on the tangent space, for example in relation to the form of work wo}, = (A,-) and 
the form flux oS = 2"(B,...), in the presence of the inner product (, ) and the 
volume form {2”, respectively. 


D.1.3 Curvilinear Coordinates and Metric 


a. Curvilinear Coordinates, Metric, and Volume Form 


Suppose that in an n-dimensional surface (manifold) we have a metric, which in 
local coordinates (t!,..., t”) (in the local charts) is given by the form g;;(t) dt! dt/, 
determined by the scalar product (, )(¢), with the corresponding parameter f¢ of the 
tangent plane (tangent space) to the surface. 

For example, if the surface (or curve) is given in a parametric form, it is em- 
bedded into the Euclidean space, and then the scalar product in the tangent planes 
(spaces) to the surface is naturally induced from that in the ambient space. 

We even know how to find the area of such a surface (n-measure), i.e., it is 
necessary to integrate the volume form 


2 =, /det gij(t) dt! A--- Ade”. 


b. Orthogonal Systems of Curvilinear Coordinates and Unit Vectors 


Recall that a system of curvilinear coordinates (t!,..., 1”) is called orthogonal if 
8ij =0 fori FH j. 

The length element in an orthogonal system of curvilinear coordinates is written 
in a particularly simple form: 


ds? = gi (t)(dt!)? +--+ + gan (t)(dt")”. 


It is often rewritten in the more compact notation 
ds? = Ey(t)(dr!)? +--- + En((at")’. 


The vectors €; = (1,0,...,0),...,& = (0,...,0, 1) of the coordinate directions 
form a basis of the tangent space, corresponding to the value of the parameter f. But 
the norm (length) of these vectors is, in general, not equal to one. We have always, 
independent of whether the system of coordinates is orthogonal, (&;, &;)(t) = gii(t), 
ie., 1& || = /eii@, i €¢ (1,...,n}. 

Thus, the unit vectors (e),...,@n) (vectors of length one) of the coordinate di- 
rections have the following coordinate representation: 


1 1 
a=( 10,....0), Pere én= (0,....0, =). 
Vv &1l 8nn 
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In particular, if the system of curvilinear coordinates is orthogonal, then the follow- 


ing system of vectors of coordinate directions will be an orthonormal basis in the 
corresponding tangent space: 


1 1 
if ea Oe SONS. -ae53 =([0,...,0, —— }. 
a (= ) rf ( iE) 


c. Cartesian, Cylindrical, and Spherical Coordinates 


As examples of orthogonal coordinate systems we have the standard Cartesian, 
cylindrical, and spherical coordinates in R?. 


Problem 1 Write down the metric g;;(¢) dr! dt/ in each of these coordinate systems 
and find an orthonormal basis (1, é2, e3). 


Answer In Cartesian coordinates (x, y, z), cylindrical coordinates (r, gy, z), and 
spherical coordinates (R,y,@) of the Euclidean space R*, the quadratic form 
gij(t) dt‘ dt’ has the following form: 


ds* = dx* + dy” +dz7 = 
= dr? +r? dy? + dz? = 
= dR? + R? cos” 6 dy” + R? dé”. 


In Cartesian, cylindrical, and spherical coordinates, the triples of unit vectors of 
coordinate directions are the following, respectively: 


e, = (1,0, 0), ey = (0, 1,0), e, = (0,0, 1); 


1 
er = (1,0, 0), eo= (0.7.0). e, = (0,0, 1); 
r 


1 1 
= (1,0, 0), = ( 0, _—_,0}, = (0,0, = J. 
er = ( ) “¢ ( Rcosé ) a ( =) 


D.2 Operators grad, curl, div in Curvilinear Coordinates 
D.2.1 Differential Forms and Operators grad, curl, div 


The differential dU of a function U is a 1-form. When one has a scalar product (, ), 
as we know, to the 1-form dU corresponds a vector A such that dU = (A, -). This 
vector is called the gradient of the function U and is denoted by grad U. 

Thus, dU = (grad U,-). 
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Suppose that in the Euclidean space R° (or in any three-dimensional Riemannian 
manifold) we have the 1-form ol}, = (A, -) corresponding to the field A. The differ- 
ential dw : of this form is a 2-form oe corresponding, in the presence of a volume 
form 923, to some vector field B (ie. wr = 23(B,-,-)). Then the field B is called 
the curl of the vector field A, and is denoted by curl A. 

Thus, do}, = w?. 4. 

If one has a volume form £2” on an n-dimensional surface (for example on R”), 
then there is defined an (n — 1)-form for the flux of a vector field B, namely the form 
ow’, | = 2"(B,-, -). The differential dw’, of this (n — 1)-form is an n-form, which 
therefore has the type o§2”. The proportionality factor, the function p, is called the 
divergence of the vector field B and is denoted by div B. 

Thus, dw’, | = (div B)Q". 


D.2.2 Gradient of a Function and Its Coordinate Representation 


a. Coordinate Representation for the Correspondence Between a Vector 
and a 1-Form 
In Sect. D.1.2, we derived a relation between the coefficients of a 1-form ol = (A,:) 
and the coordinates of the vector A = A’&;. If we take the unit vectors e; instead of 
the vectors &, and since &; = /gjje;, then the coordinates of the vector A = A‘e; 
in the basis {e;} and its former coordinates are related through the equation Aj, = 
A' ./gij fori € {1,...,n}. 
Hence all new related formulas have the form 
Ai Ai 
e 
aj = &ij —— 
Vv Sii V &Sii 
These formulas allow us to write, in terms of the vector A = Ale;, the corre- 
sponding form ol = (A, -) =a; dt/ and conversely, to write the vector A = A{e; in 
terms of the 1-form w! = aj dt/. 


Problem 2 Write down in Cartesian, cylindrical, and spherical coordinates of the 


Euclidean space IR? the explicit form of the 1-form ol, = (A,-), corresponding to 


the vector A = A’e;. 


Answer The 1-form o}, has the following form, in Cartesian coordinates (x, y, z), 
cylindrical coordinates (r,g,z), and spherical coordinates (R,gv,0) of the Eu- 
clidean space R?, respectively: 


wl = A,dx + Aydy+A,dz= 
= A,dr + Agrdg + A,dz= 
=ArdR+ AgRcosydg + Ag Rdé. 
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b. Differential of a Function and the Gradient 


We shall apply the general formula relating the vector A and the form oo}, in the case 
of the form dU = (grad U,-), in order to find the decomposition gradU = Aje;. 


i — Ww gri j coe OU i — gif sg, aU. 
Since dU = agi dt/,i.e., aj = arr? then we have AL = g Git 5, 


In the case of an orthogonal system of curvilinear coordinates, the matrix (9;;) 
is diagonal, as well as its inverse matrix (g'/). Moreover, g’’ = 1/g;;. Hence in this 
case, 


1 o0U 


1 aU 
dU = ———e, + ss 
oo V Sil art! / 8nn at" a 


c. Gradient in Cartesian, Cylindrical, and Spherical Coordinates 


Problem 3 Write down the vector gradU = Ale; in Cartesian, cylindrical, and 
spherical coordinates of the Euclidean space R?. 


Answer The vector grad U has the following form in Cartesian (x, y, z), cylindrical 
(r, 0, z), and spherical (R, g, 8) coordinates of the Euclidean space R’, respectively: 


gradU = ax ex + ey + e,= 


dy 0z 
aU 10U aU 
=. aR oy rr ag aes 
aU 1 aU 1 0U 


aR =’ Reosd ag” | R200” 


D.2.3 Divergence and Its Coordinate Representation 


a. Coordinate Representation for the Correspondence Between a Vector 
and an (n — 1)-Form 


We know that if there exists a nondegenerate n-form 2” in an n-dimensional vector 
space, then one can establish a one-to-one correspondence between a vector B and 
the (n — 1)-form are = 922"(B,...). We wish to write down an explicit formula 
relating the coordinates of the vector B = B’é; and the coefficients of the form 


we =bjx'A---x'! A--- Ax", considering that both objects are expressed in terms 
of the one basis {&;} of the space. Here, x’ is a linear function as usual, whose action 
is given by assigning the i-coordinate of a vector, ie., x/(v) := v!; the symbol x! 
means that the corresponding factor is omitted. The n-form 2” in the n-dimensional 
vector space is x! A --- A x” or proportional to this standard volume form, equal to 
one on the set of the basis vectors (&1,..., &). 
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In general, the value of the form Q!=x!a.--aAx" on any vector set (v1,..., Un) 
is equal to the determinant of the matrix (v! ) consisting of the coordinates of these 
vectors. Hence if we consider the rule for the expansion of the determinant on a row, 
we can write 


n os 
DPB) =) Ay Be Rea Ponte 


i=1 


However, De = 2" (B,...); thus 


n sad n oe 
ST Aa Av Ax" = YO(-1 Bix! A An! RD: 


i=l i=1 


Therefore, b; = (—1)'~!B! for every i € {1,...,m}. If instead we had the form 
co” = cx! A--. A x", then we would have the equation b; = (—1)'~!cB! for every 
ieé{l,...,n}. 

Recall also that if there is an inner product (, ) and a fixed basis {&;} in a vector 
space, then there is also a natural volume form ,/det g; a A+++ Ax" defined, as 
well as the scalar product itself, in terms of the values gj; = (&, €;). 

Finally, recall that in this case, the unit vectors (with respect to the norm) are 
not in general the vectors {&;}, but the vectors e; = &; /,/gii. Since &; = ,/gije, the 
original decomposition of the vector B = B’é; in the basis {e;} becomes B = Ble;, 
where Bi = Sei B'. 

Therefore, if one has a scalar product on the space, then there is a natural volume 
form 27 = det gijx! A+++ Ax", and if Otte = 27 (B, ...), then the coefficients 


of the form ain = bx! A---Ax' A---Ax" and the coordinates of the vector B in 
the decomposition B = B‘e; in terms of the basis of unit vectors e; = &;/./gjj are 
related by the equations 


i 


; B 
bj = (I Veet gi; 


ul 


In an orthogonal basis, det g;; = g11 --- 8nn- In this case, 


bj = (-1) gis + Sit + San Bi. 


All of the above remains valid when it is applied to the case of the vector field 
B(t) and the differential form wy | = 2: (B,...) of the field generated by the vol- 
ume form. 


Thus if 27 = \/det gi;(t) dt! A... A dt”, 


wy | =b(t)dt' A---Adti A---de", 
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and B(t) = Bi (t)e; (t) is the decomposition in terms of the unit vectors of the curvi- 
linear coordinates (t!, ...,¢”), then 


pee ee bade ier i-1_ Vii, 
bi = (-1) B., =(-1)" 3); 
e 
AV 8ii J det gi; 


If the system of curvilinear coordinates is orthogonal, we come back to the rela- 
tion bj = (-1)'! Vegi - ++ Bi * San Bi. 

In particular, for a 3-dimensional orthogonal system of curvilinear coordinates 
ct}, t?, t?), using the same notation E; = g;; mentioned at the beginning, it is pos- 
sible to write the following coordinate representation of the form wo, corresponding 


to the vector B = Ble, + B2e + Bees: 
wy = BL /E.E3 dt? A dt? + ne de? A dt! + B/E, Eo dt! A dt? = 


= EEE ( Be 7 : —* dt! adt 2 
VE, TE ae 


(Bear in mind that in the 3-dimensional case, the 2-form @ is not usually written 


as by dt? A dt? + ay dt! A dt? + b3 dt! A dr”, but as ay dt? A dt? + az dt} A dt! + 
a3 dt! A dt*; for example, Pdy A dz+ Qdz A dx + Rdx Ady.) 


Problem 4 Specify the explicit form of the 2-form wr, — 23 (B, ...) corresponding 


to the vector field B = Bie; in Cartesian, cylindrical, and spherical coordinates of 
the Euclidean space R?. 


Answer The form ors has the following form in Cartesian (x, y, z), cylindrical 
(r, 0, z), and spherical (R, y, 0) coordinates of the Euclidean space R?: 


wy = By dy Adz+ Bydz A dx + B,dx Ady = 
= B,rdg A dz+ By dz Adr + Bzrdr A dg = 
= BrR* cos dy A dé + ByRdO A dR + Bg Rcos@ dR A dg. 


b. The Differential Form of a Flux and the Divergence of the Velocity Field 


The form On _ = 27 (B,. ..) is often called a form of a flux, since when B is the 
flux velocity field (at least for n = 3), one has to integrate exactly this form to find 
the outflow (flux) through a surface. 

The differential of the form of a flux on! is an n-form, proportional to the 
volume form. The coefficients of proportionality are called the divergence field B, 
as we know. Thus dwt, | = div B-Q%. 

We want to study the field B = Bie; itself and find its divergence div B. We 
already know how to find the form of a flux wy! from the field B = Bie;. We shall 


D.2 Operators grad, curl, div in Curvilinear Coordinates 679 


find it, compute its differential, and obtain an n-form, proportional to the volume 


form, whose coefficients of proportionality are the divergence of the field B. 


Let us show this. We write the (n — 1)-form o'y in the following form: 


ot! =by(t)dtl a-.-Adtia--- Ade", 


We compute its differential 


n-1 . i i-l 1 n 
dot! = Bric dt! a... Ader". 


We express the coefficients b; of the form ao through the coordinates Bi of the 


vector B = Ble;: 


n 
0 /./detg;; _. 
dot! = bs (2) dt! a...» A dt”. 


att iad 


n=1 


We compare this form with the volume form 


Qt = Jfdetgij(t)dt! A--- Ade", 


1 ". 8 (fdetgi; _. 
div B = 3 ( <5) 
J det gi; ~1 or! Sii 


n 


and we obtain 


In an orthogonal system of curvilinear coordinates, this formula takes the form 


div B = : (>: a (= a)). 


— e 
Sii 


c. Divergence in Cartesian, Cylindrical, and Spherical Coordinates 


Problem 5 Write down formulas to calculate the divergence of a vector field 
B= Bie; in Cartesian, cylindrical, and spherical coordinates of the Euclidean 
space R?. 


Answer In Cartesian coordinates (x, y, z), cylindrical coordinates (r, gy, z), and 
spherical coordinates (R, v, 0) of the Euclidean space IR3, the divergence div B of 
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the vector field B = Bie; can be calculated according to the formula 
div B oe + a ess 
ivB= = 
ax dy Oz 


= 1 (/orB, i dBy Es dB, 
r\ or dp 


1 dR cosOB dRB dRcosOB 
Grea 


~ R2 cosy aR ay a0 


D.2.4 Curl of a Vector Field and Its Coordinate Representation 


a. Correspondence Between a Vector Field A and the Vector Field B = curl A 


We shall now consider the special 3-dimensional case. We shall assume, as before, 
that we are given a metric g;;(f) dr‘ dt/ in the curvilinear coordinates (t!, t7, 3), 
generating at the same time the volume form 23 = ,/det gi; (t) dt! A dt? A dr?. 

In this case the vector field A = Abe; corresponds to the 1-form ol, and the 
differential do), of this form, as a 2-form ((n — 1)-form), corresponds to a vector 


field B = Bie; such that do}, = OR. This vector field B is called, as we know, the 
curl of the original field A and is denoted by curl A. 


b. The Coordinate Representation of the Correspondence Between Vector 
Fields A and B = curl A 


We wish to learn how to calculate the coordinates of the field B = curl A in terms of 
the coordinates of the vector field A. According to the procedure described above, 


from the vector field A = Abe; we build its corresponding 1-form ol, =(A,>): 


ow! =a; dt! = 2a at. 
V8 ii 
We take its differential 


fight 98 BAD ah ae = 
AW atk\ Vein 


a os a ar 
= o( ze a!) i( ea Al) ) ar nar + 
at? \ /8ij Ot? \ SB ii 
F) - F) «itd 
+( 3( Sli al) ( 83) a!)) dt? A dt! + 
at? \ /8ij Ot \ S8ii 


3 ; y\ a of ok 
+ ( ; ( 82 At) o( Sli at)) dt! ~ dr”, 
Ot \ Bij Ot” \ /8ii 
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considering this form a form of type wr: By comparing the coefficients, we have 
wy = dw! = by dt? A bz dr? A dt! + b3 dt! A dt?. We obtain the coordinates B! = 
Bit b; of the vector B = curl A. 


a/ det(gi;) 
In the case of a 3-dimensional orthogonal system of curvilinear coordinates 
ct}, t?, t?), the formula simplifies. In this case, 


do = a5 (gi A‘) de® A dr’ = 
= (sa (/93343) — x (VmaA2)) ar? na + 
+ (2 (vatial) - 2, ( Vaal) ) a8 aan! + 
+ (Sy (ve@A2) - 2 (vamiat) ) ar! nar, 


and using the notation E; = g;;, it is possible to write the coordinates of the vector 
curl A = B = Be, + Been + B3e3: 


git dA3/E3 9A2/ED 
a J Eo E3 at? ar3 , 
ee Gee ‘Ai Es 
© JSE3E, ars at! ; 
gine Td (Ae dAL/E\ 
o JE E> ot! at? ; 


which means that 


VE\e, VE2e. VJ E363 
curl A = —————]_ 0] 02 03 «Y; «x 
JE, EoE 
MOS | VEAL JE:A2 /E3A3 


c. Curl in Cartesian, Cylindrical, and Spherical Coordinates 


Problem 6 Write down the formula to calculate the curl of a vector field A = 
Ale, + Azen + A3e3 in Cartesian, cylindrical, and spherical coordinates of the Eu- 
clidean space R?. 


Answer In Cartesian (x, y, z), cylindrical (r, g, z), and spherical (R, gy, 0) coordi- 
nates of the Euclidean space, the curl (curl A) of the vector field A = Ale it Ae. + 
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A3e3 is calculated according to the formula 


dA, dAy dA, dAy dA, 
curl A = | —— — —— — - e,= 
ee Oz Oz ax dy 
dA, _ OrAg Ay drAg OA; 
= ery + ez = 
“ag Oz ae or dp 
1 dAg dAgcosé nee 
—) eo + 
Roos \ d@ 00 


1 (/dRAg 1 OAR 
+ eo. 
R\ OR cos@ 09 


Appendix E 

Modern Formula of Newton-Leibniz 
and the Unity of Mathematics 

(Final Survey) 


E.1 Reminders 


E.1.1 Differential, Differential Form, and the General Stokes’s 
Formula 


a. What Happened and Was the Reason That Brought Us to This Kind of Life 


We already began the ascent to the modern Newton—Leibniz formula at the very 
beginning of this course of mathematical analysis, when we defined the differential 
df (x) of a function f : X — Y at the point x. By analyzing this concept gradually 
in detail, we found that it is a linear function operating on a linear vector space 
T,X of displacements from the point under consideration with values in the space 
TyY of displacements from the point y = f(x). The spaces 7, X and T,Y are called 
tangent spaces to X and Y at the corresponding points. The differential itself is also 
called the tangent mapping or total derivative with respect to the original mapping 
(function) f : X — Y at the point x. 

Once one has become acquainted with the concept of tangent line or tangent 
plane to a surface, one understands the origin and the geometric meaning of this 
terminology. 

Passing to functions of several variables and mappings of multidimensional ob- 
jects, we left the definition of the differential unchanged, but every time, we ex- 
plicitly deciphered the coordinate representation of the differential. In this way, the 
notion of the Jacobian matrix of a mapping appeared. 

We know that the differential of a function f : R” — R has the form 
or da” aes OF ayn 


df) = ar ax" 


i.e., it is a linear combination of differentials of simple functions, the coordinate 
functions, and the value of the differential df(x)(&) at the vector € € T,R” coin- 
cides with the value of the derivative Dz f(x) of the function on this vector, and 
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since dx! (&) = &', one has 


3 a 
afore= Felt t Joe 


ox” 


If you are acquainted with the linear algebra of linear, multilinear, and skew- 
symmetric forms and the operation of their external product, you could, by applying 
this to differentials, write a differential form of the type 


o* (x) =aj,..i,(x) dx! A-+- A dx, 


realizing that this is a skew-symmetric k-form on the tangent space whose value 


on the set of vectors (€,...,&) can be calculated if the value of dx Aw A 
dx'’*(&,,..., &) is known. Lastly, this is equal to the determinant of the matrix 

gi sei git 

gi ae gi 


as we know from algebra (given that dx! (é)= él ). 

Recall that we were led to differential forms by the change of variables for- 
mula for a multiple integral. For a one-dimensional integral, the form f(x) dx, 
standing under the integral sign, dictated the correct change of variable formula 
FS (g(t)) dg(t). We were concerned, as Euler was, about the fact that this was not the 
case for higher-dimensional integrals. We wanted to correct this deficiency and at 
the same time understand what we are actually integrating, since the result should 
not depend on the choice of the system of coordinates. 

Analyzing this problem, we also had to figure out a number of concepts, not only 
in algebra but also in geometry. We understood what a k-dimensional surface is, 
curvilinear coordinates, local charts, local maps and atlas, what the orientation of 
a surface is, and how it is specified, what the border of a surface and the induced 
orientation on the border are, and finally what all of this looks like in the general 
case of manifolds of dimension k. 

We had to analyze what occurs with our objects and operations under a change 
of coordinate system. We also had to figure out the direction in which points, vec- 
tors, and functions on those objects are transferred, in particular forms under smooth 
mappings, and how exactly to implement the corresponding transfer in the coordi- 
nates. At the same time, we convinced ourselves that the operation of differentiation 
on forms is indeed invariant with respect to the choice of coordinate system. The dif- 
ferentiation of forms, in the coordinate representation, is realized in the most simple 
and natural way, 


dak (x) = daj,..i, (x) dx! A+ A dxi*, 


which it is often taken, for this reason, as the original definition of this operation. 
Appealing to some suggestions from physics (computation of work, flux), we 
realized that we integrate differential forms not only because they solve the original 
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problem about the change of variables formula in multiple integrals, but also they 
lead to the following far-reaching generalization of the classical Newton—Leibniz 
formula: 


This formula, frequently called the general Stokes’s formula, rightfully should be 
called the Newton—Leibniz—Gauss—Ostrogradskii-Green—Maxwell—Cartan—Poin- 
caré formula. 


b. The Problem of Primitives Yesterday and Today 


One of the very first questions in classical mathematical analysis is the question 
about the inversion of the operation of differentiation, more precisely, the question 
of whether every function f (for example, continuous) is the derivative of some 
other function, and if so, how to find the antiderivative or primitive F of the given 
function. In the language of forms, this question is whether a |-form f(x) dx is the 
differential dF of some 0-form, i.e., a function F. 

We gave a positive answer to this question, considering everything over a numer- 
ical interval. We did not even consider any other situation. If you ask yourself the 
same question, for example, for a function identically equal to one on the circle or 
for an appropriate form dg, you will immediately realize that the answer is nega- 
tive. There is no differentiable function on the circle whose derivative everywhere 
is equal to one. 

This is one of the manifestations of a relation between a question of global anal- 
ysis and the topology of the domain, where the question is posed and solved. 

A significant part of the following text is devoted to a deeper, although not com- 
plete, discussion of this relation. 

Generalizing the classical situation, we shall ask the following question: Given a 
differential k-form w*, we look for a (k — 1)-form w*! such that ok = dwk—!. 


c. Closed and Exact Differential Forms 


Differential forms w* having a primitive (i.e., being the differential of some form 
wk—1!: wk = dwk—!) are called exact forms. 

We shall easily prove that an obvious necessary differential condition for the 
exactness of a form w* is the equality dw* = 0, due to the fact that the external 
redifferentiation of any differential form is identically zero. 

If the differential of a form is equal to zero, the form is called closed. 

Thus, closedness is a necessary condition for the exactness of a form. 

Previously, we considered in all details and interpretations the case of 1-forms. 
We also convinced ourselves that although closedness is a necessary condition for 
exactness, this condition is not sufficient, and it is significantly associated with the 
topology of the domain in which the problem is posed. 
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In physics, potential vector fields play an important role. If we have a scalar 
product (,) (or a nondegenerate bilinear form) in some space, then there arises a 
correspondence between linear functions (forms) and vector fields, defined by the 
equality ol (x)(&) = (A(x), €). Incidentally, when we want to calculate the work 
that should be done by a vector field along a path y, then we just integrate the 
form ow}, , called a work form. The remarkable characteristic of potential vector fields 
is that the work on those fields depends only on the beginning and the end of the 
path of transition and is equal to the difference between the values of the potential 
generating this field. In particular, the work on a closed contour (a cycle) with such 
a vector field is zero. 

In the language of vector fields, the differential characteristic of a potential vector 
field is, as we know, that they have no rotation (their curl vanishes). We also know 
that irrotational vector fields are not always potential vector fields, and it depends on 
the topology of the domain on which they act. In a simply connected domain, this 
necessary characteristic is also sufficient. For example, in a three-dimensional ball 
or a ball with deleted center, or in a cut-out ball, every irrotational field is a potential 
field; in the two-dimensional disk this is also the case, but in the disk with the center 
deleted, it is no longer the case. (Recall the typical example: in writing the form dg 
in Cartesian coordinates (x, y), we considered the vector field (—y, x)/ (x2 + y?) 
corresponding to it.) 

Along with the necessary differential condition of exactness of a form, which 
“feels” the form locally, we had an integral criterion for exactness of 1-forms, con- 
sisting in the fact that the integral of a form over any cycle (closed path) lying in the 
considered domain is always equal to zero. 

This integral criterion for the exactness of forms remains true with respect to 
forms of any degree, with the proper understanding of what the cycle of the corre- 
sponding dimension should be. 

This is one of de Rham’s theorems, which has as a consequence a much older 
theorem, also called Poincaré’s lemma, asserting that in the space R”, in a ball, or 
on any other domain homeomorphic to it, every closed form is exact. 


E.1.2. Manifolds, Chains, and the Boundary Operator 


a. Cycles and Boundaries 


In the previous Stokes’s formula we have geometric objects (curves, surfaces, mani- 
folds, and their boundary, i.e., the border), on which we integrate the corresponding 
differential forms. 

Similar to the operator d of differentiation, we have the operator 0, which maps 
surfaces to their boundary. The boundary 0M* of a manifold M* is also a manifold, 
but with one dimension fewer. Moreover, the variety 9M* no longer has a boundary, 
i.e., the reapplication of the operator 0 always gives the empty set. In this sense, the 
operators d and 0 are similar. But if the operator d increases the dimension of the 
object by 1, the operator 0 reduces the dimension by 1. 
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The concepts of closedness and exactness in forms correspond here to the con- 
cepts of cycles and boundaries. 

A compact surface, a manifold M* (later we shall say also chain) of dimension k, 
is called a cycle of dimension k if 0M = Q, i.e., M does not have any boundary 
points. 

Thus, the sphere of dimension k is a cycle of dimension k. 

A surface, manifold M* (a chain), is called a boundary if it has a “primitive” in 
the sense that there is a surface or manifold M‘+! (chain) such that 0M k+l — yk. 

It is clear that if the surface or manifold is the boundary of some other compact 
manifold, then it must be a cycle. However, the situation here is similar to that of 
forms, where the conditions are necessary but in general not sufficient to ensure that 
in the domain where this cycle lies, there is also a manifold such that the cycle is 
the boundary of that manifold. 

Take, for example, a circular ring, or annulus, in the plane. Then every circle 
containing the hole is a cycle, but it is not the boundary of a manifold lying on 
the annulus. But if instead of an annulus we consider a disk, then the situation is 
radically different. 

Let us consider the boundary of the annulus, and we shall recall the following 
fact. The operator 0 acting on boundaries is not a simple set-theoretic transforma- 
tion. On an atlas of the surface or manifold, this operator gives an atlas of the bound- 
ary, which is called the induced atlas of the boundary. If the original atlas consists 
of compatible charts, then under this operator, the induced atlas will also have this 
property. Thus if the manifold is orientable, then its boundary possesses an orienta- 
tion, which is called the induced orientation or agreed or compatible orientation of 
the boundary. 

If the annulus G that we just discussed is oriented with the standard left frame of 
the Cartesian coordinates in the plane, then its boundary, consisting of two circles 
V1, 2, Will be oriented such that the outer circle y2 goes in the positive direction 
(counterclockwise) and the inner circle is negatively oriented (clockwise). The in- 
tegral in such a boundary is reduced to the difference between the integrals over y; 
and y2. It is useful to write that as 0G = yoy — "14. 

For example, if you need to calculate the work that is accomplished by five turns 
along the path 721, then three along the path 7,4, and finally two along 77_, then 
you have to integrate over the chain 5y2+ + 3y14 + 272— =5y24. + 3y14 -— 24 = 
3y24 + 3y14. The integration over such chain corresponds, of course, to a linear 
combination of the integrals over yj4 and y2+. 

This discussion illustrates why it is useful to consider linear combinations of 
geometric objects. These are called chains. We have explained here only where 
the concept of chains comes from, what are they in general, and where and why 
they are useful. We are not going into general and formal definitions, since we do 
not need them here in the more general form, and they can be found in the book. 
Analogously, just as in analysis, when we are forced to go from the usual ordinary 
functions to generalized functions, in geometry one goes from the simplest objects 
like cubes and chains of cubes to their generalizations like singular cubes and chains 
of singular cubes. Moreover, we then do the next extension and invent the concept 
of flux, which combines differential forms, generalized functions, and manifolds. 
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We shall see below that it is sometimes possible to calculate the integral of a form 
over a cycle by going to some other cycle, sometimes significantly simpler, which 
is in some way associated with the original cycle. This is a remarkable, important, 
and useful fact, which is used in different areas of mathematics and its applications. 

In order to understand the relation between cycles, we have to consider the fol- 
lowing fact: their difference must be the boundary of an object lying on the domain 
we are considering. We say that such cycles are homologous in this domain. 

For example, two closed oriented paths yj, y2, on a domain D or on a mani- 
fold M are homologous if we can find an orientable surface Se cD (S2 Cc M) such 
that chad =yr4 — Vi+. 

Thus, the circles 714, y2+ considered above are homologous in the annulus G+. 

Since the operator 0 acts on boundaries and is extended by linearity over chains, 
it is possible to determine the homology of chains. 

For instance, the chains yj, and 272, are not homologous on the annulus G1. 

We shall discuss the role and applications of the concept of homology of cycles 
in the context of the integration of differential forms. 


E.2 Pairing 


E.2.1 The Integral as a Bilinear Function and General Stokes’s 
Formula 


a. The Integral of an Exact Form over a Cycle and of a Closed Form over a 
Boundary 


We introduce first some useful notation. 

Let §2(M) denote the whole set of differential forms on a manifold (or surface) 
M, and let 2*(M) denote the subset of forms of order k (i.e., k-forms), Z«(M) its 
subset of closed k-forms, and BK(M ) its subset of exact k-forms. 

Analogously, let C(M) be the set of chains on a manifold (or surface) M, and 
let C,(M) be the subset of chains of dimension k (k-chains), Z,(M) the subset of 
cycles (k-cycles), and B,(M) its subset of boundary cycles (k-boundaries). 

Thus, 2(M) > 2*(M) D Z*(M) D B*(M) and C(M) Dd Cy(M) D Z;,(M) D 
By(M). 

As long as we do not change the manifold M on which we wish to calculate 
something, in order to simplify the notation we shall remove the symbol M when- 
ever it does not lead to confusion, that is present in the just-discussed notation. 

Now we shall make a concluding remark. 

Consider the integral of an exact form b* € B* over the cycle zy € Zz and of a 
closed form z‘ € Z* over a boundary by € By. Employing Stokes’s formula, we find 
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i p= [ dol! f ots f all 0 

Zk 2k Ozk 1) 
eet =) ack= [ 0=0. 
be OCk+1 Ck+I Ck+1 


b. Integral of a Closed Form over a Cycle and Its Invariance Under Certain 
Changes of the Form and the Cycle 


that 


and 


The remark that we just made leads to the following important and very useful 
conclusion. 

We shall consider now the integral of a closed form z* over a cycle zx. Given that 
the addition of an exact form b* to a closed form z* gives again a closed form (since 
d(zk + b*) = dz* + db* = 0), and the addition of a boundary cycle by to a cycle z, 
gives again a cycle (since 0(by + zx) = Obx + 0Z% = 0), recalling the remark we just 
made, we can now write the following chain of equalities: 


[2-fen- fen [eh 


Here [zk] means the class of forms that differ from the original form z* modulo 
an exact form, and [zx] is the class of cycles differing from the original one up to a 
boundary cycle. 

Thus by calculating the integral of a closed form z“ over a cycle zx, we can afford 
to choose, without changing the value of the integral, any cycle from the class [zx] 
and any form from the class [zk]. 


k 


k 


E.2.2 Equivalence Relations (Homology and Cohomology) 


a. Toward Uniformity in Terminology: Cycles and Cocycles, Boundaries 
and Coboundaries 


Along with the unification of notation, it is convenient to agree on the following 
standardization of terminology. Since the elements of the sets Z, and By; are called 
cycles and boundaries, respectively, we shall call the elements of Z* and B* cocy- 
cles and coboundaries, respectively. 

Thus a cocycle is a closed differential form, and a coboundary is an exact differ- 
ential form. 
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A class [zx], or more precisely a class [z,](M), is called a homology class of the 
cycle zz on the manifold (or surface) M. 

A class [z*], or more precisely a class [z*](M), is called a cohomology class of 
the cocycle z* on the manifold (or surface) M. 

The operator 0 taking boundary chains is called a boundary operator, and the 
operator d acting on differential forms is called a coboundary operator. 

Two cycles are homologous on the manifold (or surface) M if their difference is 
the boundary of a chain lying on M. 

Two cocycles are cohomologous on the manifold (or surface) M if their differ- 
ence is a coboundary on M (i.e., two closed forms are cohomologous on the mani- 
fold if their difference is an exact form on the manifold). 


E.2.3 Pairing of Homology and Cohomology Classes 


a. The Integral as a Bilinear Function 


The integral fic ok of a k-form over a chain on some manifold M can be considered 


a pairing (w*, cx) of objects from two vector spaces, namely the linear space of 
k-forms Q* and the linear space of k-chains Cx. 
We can conclude, knowing the properties of the integral, that the operation 


(w*, cx) is bilinear. 


b. Nondegeneracy of the Bilinear Form of Pairing (de Rham Theorem) 


When we considered the above pairing between cycles and cocycles, we obtained 
an important result, which can be stated now in the following form: 


(2, zx) = ([z*], (zx). 


Recalling the definition of the cohomology and homology classes [z*], [zx], 
we can say that they are elements of the quotient space H* := Z*/B* and Hy := 
Zx/ Br, respectively. 

The vector spaces H K and Hy, whose complete notation is H k(M) and H;(M), 
are called the space of k-dimensional cohomology of the manifold M and the space 
of k-dimensional homology of the manifold M, respectively. 

Thus, the integral actually also pairs cohomology and homology classes. The 
pairing (Iz*], Lze]) is clearly linear and is nondegenerate, as was shown by de Rham. 

(Recall that a bilinear form (, ) is called nondegenerate if once we fix one of the 
arguments with a nonzero value, the form is not identically zero with respect to the 
other argument.) 
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c. Integral Criterion for the Exactness of a Closed Form 


De Rham’s theorem that we just mentioned implies the following criterion of exact- 
ness of a closed form: A closed form z* = w* on a manifold (surface, domain) M 
is exact on M if and only if the integral of this form over every k-dimensional cycle 
lying on M is equal to zero. 

Indeed, f (z*, ze) = 0 for every cycle z, lying on Ms then according to de Rham’s 
theorem, [z*] =0 in H*‘ = 7B. This means that z* € B*. 

We have examined in detail all aspects for the case of 1-forms, and we also 
proved this criterion in this case. We have now established this criterion in general. 

In particular, you can now say by looking at a manifold or domain where there is 
an irrotational vector field or a divergence-free vector field whether the vector field 
is a potential, or it has a vector potential (i.e., it is the curl of some vector field), 
respectively. 

We can also use de Rham’s theorem on the second argument, of course. For 
example, if we know that on some manifold all the closed k-forms are exact, we can 
say that on this manifold every k-cycle is a boundary cycle (homologous to zero). 
Thus, we have a conclusion about the topology of the manifold. 


E.2.4 Another Interpretation of Homology and Cohomology 


a. Duality of Operators d and @ 
In the notation of the pairing (ok, cx), Stokes’s formula has the form 
(doX!, Ck) = ior, dcx), 


showing the duality between the operators d and 0. 


b. The Operators d and 0 as Mappings 


In some cases, it is useful to write the full notation of the operators d and 0, for 
example, in the notation of the following sequences of linear mappings: 


dk-2 1 d-1 dk dk+1 
ee Oka So Ok SR Okt) Se... 


OK-1 Ok+1 Ok+2 
ee (Ge ee 


Using the standard notations Ker and Im for the kernel and the image of a linear 
mapping, we can write, for example, that 


Z* = Kerd,, Z, = Ker dx, BK =Imdy_1, By, = Im dg, 
and thus 
H* = Kerdg/Imdy_, and Hy = Ker 0x / Im dy 41. 
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E.2.5 Remarks 


A few words as a conclusion. I repeat that this is just an overview, an overview of 
the principles that does not go into details. The details are covered in the textbook, 
and numerous developments are given in the specialized literature, which is easier 
to read with an initial idea of the subject, of course. 

In physics and mechanics, we often speak in the language of vector fields. How- 
ever, you now know how to translate problems in the language of vector fields into 
the language of differential forms, and conversely you know how to relate standard 
operators like grad, curl, div with the operator d of the exterior differentiation of 
forms. 

In continuum mechanics, the Hamiltonian operator V is used. Some techniques 
that are used with it are presented in the text. There you will also find the answer 
to the question of how to represent and calculate the operators grad, curl, div in 
curvilinear coordinates. 

All of this, including Stokes’s formula, has numerous applications. For example, 
look at the deduction of Euler’s equation in continuum mechanics, or write down 
Maxwell’s equations for an electromagnetic field. I shall not mention the internal 
mathematical applications in analysis, especially complex analysis, geometry, alge- 
braic topology... 
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Index of Basic Notation 


Logical symbols 


=> logical consequence (implication) 
<> logical equivalence 
= equality by definition; colon 

on the side of the object defined 


Sets 

E closure of the set E 

OE boundary of the set EF 

E := E\0E interior of the set EF 

Bcx,r) ball of radius r with center at x 

S(x,r) sphere of radius r with center at x 

Spaces 

(X, d) metric space with metric d 

(X, T) topological space with system t of open sets 

R”"(C”) n-dimensional real (complex) space 

R! =R(C! =C) set of real (complex) numbers 

x =(x!,...,x") coordinate expression of a point of n-dimensional space 
C(X, Y) set (space) of continuous functions on X with values in Y 


Cla, b] abbreviation for C({a, b], R) or C({a, b], C) 

C“ (X,Y) set of mappings from X into Y that are k times continuously differen- 
tiable 

C[a,b] abbreviation for C™ ([a, b], R) or C™ ({a, b], C) 

Cpla, 5] space C[a, b] endowed with norm || f'|| p 


Cola, b] space C[a,b] with Hermitian inner product (f, g) of functions or 
mean-square deviation norm 
R(E) set (space) of functions that are Riemann integrable over the set E 


Ria, b] space R(E) when E = [a, b] 
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R(E ) space of classes of Riemann integrable functions on E that are equal 
almost everywhere on E 

R p(E\(Rp(E)) space R(E) endowed with norm || f|lp 

RoE (RE )) space R(E ) endowed with Hermitian inner product (f, g) or 
mean-square deviation norm 

R pla, b], Rala, b] spaces Rp(E) and R2(£) when E = [a, b] 

L(X; Y), (L(X1,..., Xn; Y)) space of linear (n-linear) mappings from X (from 
(X, x --- x X),)) into Y 

TM » or TM(p), TypM, T,(M) tangent space to the surface (manifold) M at the 


point pe M 
S Schwartz space of rapidly decreasing functions 
D(G) space of fundamental functions of compact support in the domain G 
D'(G) space of generalized functions on the domain G 
D an abbreviation for D(G) when G = R” 
D' an abbreviation for D’/(G) when G = R" 


Metrics, norms, inner products 


d(x1,X2) distance between points x; and x2 in the metric space (X, d) 


Ix], lll absolute value (norm) of a vector x € X in a normed vector space 

|| A] norm of the linear (multilinear) operator A 

I fllp = fp |FI?@) dx)!/?, p > 1 integral norm of the function f 

Il f lla mean-square deviation norm (|| f'||» when p = 2) 

(a, DP Hermitian inner product of the vectors a and b 

Chea. ef :8)(«) dx Hermitian inner product of the functions f and g 

a-b inner product of a and b in R? 

axb vector (cross) product of vectors a and b in R3 

(a, b, c) scalar triple product of vectors a, b, c in R? 

Functions 

gof composition of functions f and g 

oe inverse of the function f 

Sf) value of the function f at the points x; a function of x 

f(x!,...,x”) value of the function f at the point x = (x!,...,x”) © X in 
me n-dimensional space X; a function depending on n variables 
eC 

supp f support of the function f 

Tf@) jump of the function f at the point x 

{fi:t eT} a family of functions depending on the parameter t € T 


{ fn; n € N} or {f,} a sequence of functions 
i: — f on E convergence of the family of functions { f;; t € T} to the function f 
B on the set E over the base B in T 

fi: fon E uniform convergence of the family of functions {f;;t € T} to the 
B function f on the set E over the base B in T 

f =0(g) over B asymptotic formulas (the symbols 

f = O(g) over B of comparative asymptotic behavior 

f~gor f =goverB | of the functions f and g over the base B) 
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f(x) = . 1 Gn (x) over B expansion in an asymptotic series 


D(x) Dirichlet function 

exp(A) exponential of a linear operator A 
Bia, B) Euler beta function 

I'(a@) Euler gamma function 

XE characteristic function of the set E 


Differential calculus 


f'(x), fe(x), df (x), Df (x) tangent mapping to f (differential of f) at the point x 

as 0; f (x), D; f(x) partial derivative (partial differential) of a function f depend- 
ing on variables x!,...,x” at the point x = (x!,...,x”) with respect to 
the variable x! 

D, f(x) derivative of the function f with respect to the vector v at the point x 

V Hamilton’s nabla operator 

grad f gradient of the function f 

divA divergence of the vector field A 

curl B curl of the vector field B 


Integral calculus 


WE) measure of the set E 

Sg fx) dx , 

‘i fo! x") dx! .. dx” integral of the function f 
E ae 


fff", oo x) dx! ee dx” over the set E C R” 


Sy dy fy f@&, y) dx iterated integral 

i Pdx+Qdy+Rdz curvilinear integral (of second kind) or the 

i F ds, f, (E.ds) work of the field F = (P, Q, R) along 

y ie as the pathy 

J e fds curvilinear integral (of first kind) of the function f along the curve y 


integral (of second kind) over 
Sfs Pdy Adz + Odz A dx + Rdx Ady the surface S in R?; flux of 
JfsF-do, I fy (F. do) the field F = (P, QO, R) across 
the surface S 
Sf[s fdo surface integral (of first kind) of f over the surface S 


Differential forms 

w@(w?)  adifferential form (of degree p) 

w? Aw! exterior product of forms w? and w? 

dw (exterior) derivative of the form w 

i Wa) integral of the form over the surface (manifold) M 


On := (F,-) work form 


wy :=(V,-,-) flux form 
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Symbols 

6-function, 281 
5-neighborhood, 5, 11 
e-grid, 17 

k-cell, 255 

k-dimensional volume, 186 
k-path, 255 

n-dimensional disk, 180, 323 
nth moment, 402 

p-cycle, 358 

p-form, 198 

T space, 14 

T2 space, 14 

6-formula, 586 


A 
Abel summation, 392 
Abel—Dirichlet test, 375, 376, 378 
Abel’s transformation, 376 
Absolute convergence 

of a series, 374, 375 

of an improper integral, 417 

of functions, 374 
Adiabatic, 224 
Adiabatic constant, 226 
Adjoint mapping, 317 
Admissible set, 119 
Alexander horned sphere, 164 
Algebra 

exterior, 319, 320 

graded, 314 

Grassmann, 319, 320 

Lie, 72, 348 

of forms, 313 

skew-symmetric, 314 
of functions, 399 
complex, 399 
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real, 399 
self-adjoint, 402 
separating points, 400 
Almost everywhere, 114 
Alternation, 314 
Amplitude, 554 
Amplitude modulation, 580 
Analysis, harmonic, 554 
Angular velocity, 69, 70 
Approximate identity, 451 
Area 
as the integral of a form, 229-231 
Minkowski outer, 195 
of a k-dimensional surface, 188, 231 
of a piecewise-smooth surface, 231 
of a sphere in IR", 193, 440 
Asymptotic equality, 590 
Asymptotic equivalence, 590 
Asymptotic estimate, 589 
uniform, 602 
Asymptotic expansion 
in the sense of Erdélyi, 601 
uniform, 602 
Asymptotic formula, 590 
Asymptotic methods, 589 
Asymptotic problem, 588 
Asymptotic sequence, 593 
Asymptotic series, 593, 594 
general, 593 
in the sense of Erdélyi, 602 
in the sense of Poincaré, 594 
power, 598-600 
Asymptotic zero, 595 
Asymptotics, 588, 589 
of a Bessel function, 631 
of a Laplace integral, 629 
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of canonical integral, 624 Cc 
of Legendre polynomials, 614 Canonical embedding, 350 
of the Fourier integral, 625, 630 Canonical integral 
of the gamma function, 613, 620 asymptotics, 624 
of the Laplace integral, 625 Cardinal sine, 581 
of the probability error function, 618 Carnot cycle, 227 
Atlas Cartesian, cylindrical, and spherical 
analytic, 326 coordinates, 674 
of a surface (manifold), 164, 321 Category of a set, 28 
of class C, 326 Cauchy integral, 310 
orienting, 175, 328 Cauchy—Bunyakovskii inequality, 448, 499 
smooth, 326 Cauchy—Riemann equations, 310 
Average value of the function in the sense of Central limit theorem, 664, 666 
Lévy, 664 Chain, 687 
Averaging of a function using a kernel, 489 of charts, 330 
contradictory, 330 
B disorienting, 330 
Ball of singular cubes, 357 
closed, 5 Chains, 687 
in R”, volume, 440 Change of variable in an integral, 137-145, 
157-159 


in a metric space, 5 
Band-limited signal, 578 
Base 


Change of variables formula, 655 
Channel with noise, 668 


in the set of partitions, 110 Chater 
frequency, 556 
of a topology, 10 h 556 
Basis of a vector space, 494 aes 556 
Bernoulli integral, 310 Chart 


Bernoulli numbers, 626 
generating function, 626 
Bernoulli polynomials, 548 
Bessel function, 390, 408 
asymptotics, 631 
Bessel’s equation, 390, 408, 411, 430 
Bessel’s inequality, 502, 503 


local, 163, 321 
parameter domain, 163 
range, 163 
range of, 321 
Charts, consistent, 175, 328 
Chebyshev metric, 3 
é : Chebyshev polynomials, 518 
for trigonometric system, 527 Chebyshev—Laguerre polynomials, 518 


Beta function, 433-435 Circulation of a field along a curve, 235, 278 
Bicompact set, 15 Class 


Borel’s formulas, 573 
Boundary, 687 


orientation, 329 
Closed and exact differential forms, 685 


of a half-space, 179 Closed ball, 5 

of a manifold, 322 Closed form, 353 

of a p-dimensional cube, 357 Closed set, 13 

of a surface, 179 in a metric space, 5, 6 
Boundary cycle, 358 in a topological space, 13 
Boundary operator, 690 Closure, 6, 13 
Boundary point, 6, 13, 322 Coboundary operator, 690 
Boundedness Coding of a signal, 668 

total, 395 Coefficient 

uniform, 395 of thermal conductivity, 303 

uniform, of a family of functions, 371 of thermal diffusivity, 304 
Brachistochrone, 93-95 Coefficients 
Bracket, Poisson, 348 Fourier, 500-502, 504, 507, 512, 519, 525, 


Bundle of tangent paths, 347 530, 534, 535, 544, 546, 550 
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extremal property, 500 
Lamé, 268, 275 
Cohomologous on the manifold, 690 
Cohomology, 689, 690 
Cohomology class, 690 
Cohomology group, 356 
Compact set, 15 
elementary, 160 
in a metric space, 16 
Companion trihedral, 73 
Complete system of vectors, 505-510 
Completeness of the trigonometric system, 539 
Completion of a space, 24-27 
Concentration of measures, 663 
Condition 
necessary, for convergence, 373 
Conditions 
Dini, 528, 563 
Connected set, 19 
Consistent charts, 175, 328 
Constant, cyclic, 298, 360 
Content of a set (Jordan), 121 
Continuity 
and passage to the limit, 382 
of an improper integral depending on a 
parameter, 420-422 
of an integral depending on a parameter, 
406, 407 
Continuous group, 72, 336 
Contribution 
of a maximum point, 607 
Contribution of a point to asymptotics, 606 
Convergence 
absolute, 374 
of an improper integral, 417 
in mean, 521, 539 
of a family of functions 
pointwise, 363, 367 
uniform, 367 
of a series of vectors, 499 
of an improper integral, 154 
Cauchy principal value, 157 
of distributions, 459 
of generalized functions, 459 
of linear functionals 
strong (norm), 58 
of test functions, 458 
uniform, 395 
Cauchy criterion, 369, 370 
weak, 459 
Convergence set, 363, 367 
Convolution, 444-466 
differentiation, 449 
in R", 478 
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multidimensional, 478-488 
symmetry, 448 
translation-invariance, 449 
Coordinate parallelepiped, 109 
Coordinates 
Cartesian, 259, 261 
curvilinear, 163, 265 
cylindrical, 268-274 
of a tangent vector, 340 
polar, 168 
spherical, 168, 268-274 
triorthogonal, 268-274 
Cotangent space to a manifold, 340 
Covering 
locally finite, 337 
refinement of another covering, 337 
Criterion 
Cauchy, 419 
for uniform convergence, 369, 370, 374 
for uniform convergence of a series, 377 
for uniform convergence of an integral, 
415-417 
Darboux, 116-118, 131 
for a field to have a potential, 291 
for compactness in a metric space, 17 
for continuity of a mapping, 31 
Lebesgue, 114-116, 119, 122, 140, 147 
Critical point, 151 
Cube 
boundary of, 357 
singular, 357 
boundary of, 358 
Curl, 204, 260, 275, 680 
physical interpretation, 282, 283 
Curl in Cartesian, cylindrical, and spherical 
coordinates, 681 
Current function, 310 
Curvature of a curve, 73 
Curvilinear coordinates and metric, 673 
Cycle 
boundary, 358 
Carnot, 227 
of dimension p, 358 
Cycle of dimension, 687 
Cycles, homologous, 358 
Cycles and boundaries, 686 
Cyclic constant, 298, 360 
Cyclic frequency, 554 
Cylinder, 169 


D 

Darboux integral 
lower, 117 
upper, 117 
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Darboux sum 
lower, 116, 394 
upper, 116 
De Rham theorem, 686, 690 
Deformation (of a closed path), 294 
Degree (order) of a differential form, 196 
Delta function (5-function), 281, 445, 450, 
456, 457, 459, 464, 469, 479, 490, 
552, 583, 586 
shifted, 479 
Derivation 
of a ring, 352 
Derivative 
Lie, 352 
of a mapping, 61, 62 
of order n, 81 
partial, 70, 71 
second, 81, 84 
with respect to a vector, 82 
Derivative mapping, 62 
Deviation 
mean-square, 522 
Diffeomorphism, elementary, 142 
Differential 
exterior, 343, 349 
exterior, of a form, 202, 343, 349 
of a mapping, 61 
of order n, 81 
partial, 70, 71 
second, 81, 84 
total, 71 
Differential equation with variables separable, 
228 
Differential form, 198 
closed, 297, 353 
exact, 296, 353 
flux, 199 
of class C®, 342 
of compact support, 344 
of order zero, 202 
on a manifold, 341 
on a smooth surface, 209 
restriction to a submanifold, 350 
work, 199 
Differential operator, 481 
adjoint, 481 
self-adjoint, 481 
transpose, 481 
Differentiation, 61 
at a point of a manifold, 348 
of a family of functions depending on a 
parameter, 387-391 
of a Fourier series, 538 
of a generalized function, 461-464 
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of a power series, 389 
of a series, 389 
of an integral 
over a liquid volume, 491 
of an integral depending on a parameter, 
407-410, 478 
on a manifold, 348, 351 
with respect to a parameter, 423-425 
Dimension of a manifold, 321 
Dini conditions, 528 
Dipole, 299, 490 
Dipole moment, 300, 490 
Dipole potential, 300 
Direct product of metric spaces, 8 
Direction 
of circuit around a domain, 178 
Direction of motion along a curve, 178 
Dirichlet discontinuous factor, 432 
Dirichlet integral, 431, 443, 563, 601 
Dirichlet kernel, 525, 551 
Discontinuous factor, Dirichlet, 432 
Discrete group of transformations, 336 
Discrete metric, 2, 8 
Disk, n-dimensional, 180, 323 
Distance, 654 
Distribution, 456 
regular, 459 
singular, 459 
tempered, 584 
Divergence, 204, 260, 275, 676 
physical interpretation, 279-282 
Divergence in Cartesian, cylindrical, and 
spherical coordinates, 679 
Domain 
elementary, 241 
fundamental, of a group of automorphisms, 
325,330 
of parameters of a chart, 321 
parameter, 366 
simply connected, 293 
Double layer, 490 


E 
Efficiency of a heat engine, 227 
Eigenvalue, 511 
of a Sturm—Liouville problem, 511 
Eigenvector of an operator, 512 
Element of volume, 229 
Elementary diffeomorphism, 142 
Elliptic integral, 392 
complete 
of first kind, 392, 408 
of second kind, 392, 408 
modulus, 408 
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Embedding 
canonical, 350 
Entropy, 302 
Envelope of a family of curves, 253 
Equality 
asymptotic, 590 
Parseval’s, 513, 523, 541, 562, 585 
Equation 
Bessel’s, 390, 408, 411, 430 
differential, 35, 228 
Euler-Lagrange, 92 
Euler’s 
hydrodynamic, 307 
heat, 303, 576 
hypergeometric, 392 
Laplace’s, 304, 517 
Mayer’s, 226 
of an adiabatic, 226 
of continuity, 305, 306 
of state, 223 
Poisson’s, 299, 304, 488 
wave, 308, 309, 311, 574 
homogeneous, 309 
inhomogeneous, 309 
Equations 
Cauchy—Riemann, 310 
electrostatic, 286 
magnetostatic, 286 
Maxwell, 262, 263, 275, 282, 299, 311 
Equicontinuity, 396 
Equivalence, asymptotic, 590 
Equivalent atlases 
with respect to orientation, 176, 329 
with respect to smoothness, 326 
Erdélyi’s lemma, 625 
Error function 
asymptotics, 618 
Estimate, asymptotic, 589 
uniform, 602 
Euler, 433 
Euler—Gauss formula, 436 
Euler-Lagrange equation, 92 
Euler—Poisson integral, 429, 438, 560, 572, 
601 
Eulerian integral, 433-444 
Euler’s formula, 441, 649 
Euler’s hydrodynamic equation, 307 
Exact form, 353, 685 
Exhaustion, 660 
Exhaustion of a set, 152 
Expansion, asymptotic 
in the sense of Erdélyi, 601 
uniform, 602 
uniqueness, 594 


Exponential 
of an operator, 71-73 
Exponential function, 648 
Exponential function as a limit, 649 
Exponential integral, 591 
Exponential of a matrix, 650 
Exponential of operators, 650 
Exponential system, 495 
Exterior algebra, 319, 320 
Exterior differential, 202, 343, 349 
of a form, 343, 349 
Exterior point, 6, 13 
Exterior product, 196, 315, 342 
Extremum of a function 
necessary condition, 88 
sufficient condition, 88 
with constraint, 107 


F 
Family of functions, 366 
equicontinuous, 396 
at a point, 401, 402 
separating points, 400 
totally bounded, 395 
uniformly bounded, 395 
Fejér kernel, 551 
Field 
of forms, 257 
of linear forms, 198 
potential, 288 
scalar, 257 
solenoidal, 296 
tensor, 257 
vector, 257, 348 
smooth, 348 
Filter, low-frequency, 556 
Flow 
planar, 310 
plane-parallel, 310 


7107 


Flux across a surface, 215-219, 234, 278, 303, 


491 
Force 
mass, 306 
Form 
anti-symmetric, 196 
differential 
closed, 297, 353 
exact, 296, 353 
flux, 199 
of class C®, 342 
of compact support, 344 
on a manifold, 341 
restriction to a submanifold, 350 
work, 199 
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Hermitian, 45 
nondegenerate, 45 
nonnegative, 45 
on a surface in R”, 229 
semidefinite, 88 
skew-symmetric, 196, 314-317 
volume in R*, 229 
Form is called closed, 685 
Formula 
asymptotic, 590 
Cauchy—Hadamard, 375 
co-area, 237 
complement, for the gamma function, 437 
Euler—Gauss, 436 
Euler’s, 441 
for change of variable in an integral, 138 
Fourier inversion, 564, 585 
Frenet, 73 
Gauss’, 443 
Gauss—Ostrogradskii, 243-246, 279, 304, 
483, 491 
in vector analysis, 278 
Green’s, 491 
homotopy, 361 
Kotel’nikov’s, 579 
Kronrod—Federer, 237 
Legendre’s, 442 
Leibniz’, 407 
Newton-Leibniz, 238, 279, 406, 566 
Poisson summation, 586 
reduction 
for the beta function, 434 
for the gamma function, 436 
Stirling’s, 444, 613 
Stokes’, 238, 277, 279, 345-347, 359 
general, 248-251, 345 
in R?, 246-248 
in vector analysis, 278 
Taylor’s, 95, 412 
Wallis’, 430, 444, 627 
Formulas 
Borel’s, 573 
differential, of field theory, 263-265 
Green’s, 285, 286 
integral, of vector analysis, 279 
Fourier coefficients 
extremal property, 500 
Fourier cosine transform, 557 
Fourier integral, 624 
asymptotics, 625, 630 
multiple, 632 
Fourier inversion formula, 564, 585 
Fourier series, 493-520 
in a general orthogonal system, 493, 494 


Subject Index 


multiple, 550 
of generalized functions, 552 
partial sum 
integral representation, 524 
pointwise convergence, 520 
rate of convergence and smoothness, 534 
Fourier sine transform, 557 
Fourier transform, 555, 556, 559, 564, 567, 
571, 576 
asymptotic properties, 566-569 
frequency shift, 580 
in L2, 582 
inverse, 576 
multidimensional, 569 
normalized, 561 
of a convolution, 562 
of generalized functions, 585 
rate of decrease and smoothness, 566 
time shift, 580 
Frame 
Frenet, 73 
orienting, 174 
Frequencies, natural, 512 
Frequency, 553 
cyclic, 554 
fundamental, 554 
harmonic, 554 
Frequency characteristic, 556 
Frequency spectrum, 586 
Fresnel integral, 431, 443, 601 
Function 
band-limited, 578 
Bessel, 390, 408 
asymptotics, 631 
beta, 433-435 
cardinal sine, 581 
change of coordinates, 322 
current, 310 
delta, 445, 450, 456, 457, 459, 464, 469 
Dirichlet, 364 
exponential integral, 591 
fundamental, 479 
gamma, 435-438 
asymptotics, 613, 620 
incomplete, 601 
generalized, 456 
differentiation, 461-464 
of several variables, 479 
regular, 459 
singular, 459 
generating, 467 
Green’s, 465 
harmonic, 287, 304 
conjugate, 310 
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Heaviside, 461, 464, 485, 491 
limit, 363, 367 
linear, 49 
locally integrable, 448 
multilinear, 49 
of compact support, 138, 447 
phase, 625 
piecewise continuous, 529 
piecewise continuously differentiable, 529 
probability error, 601 
asymptotics, 618 
rapidly decreasing, 568 
Riemann integrable 
over a set, 120 
over an interval, 111 
sample, 581 
sine integral, 601 
spectrum of, 554 
spherical, 517 
support, 447 
system, 445, 456 
test, 458, 479 
transient pulse, 445 
uniformly continuous, 452 
unit step, 461 
zeta, 443 
Functional 
linear, 49 
multilinear, 49 
Functions, asymptotically equal, 590 
Functions, asymptotically equivalent, 590 
Functions of a very large number of variables, 
663 
Fundamental domain of a group of 
automorphisms, 325, 336 
Fundamental frequency, 554 
Fundamental sequence, 21 
Fundamental solution, 464-466, 485 
Fundamental tone, 512 


G 
Galilean transformation, 587 
Gamma function, 433, 435-438 
asymptotics, 613, 620 
incomplete, 601 
Gauge condition, 312 
Gauss’ formula, 443 
Gauss’ theorem, 491 
Gauss—Ostrogradskii formula, 238, 243-246, 
483, 491 
in vector analysis, 278 
Gaussian measures, 667 
General Stokes’s formula, 683, 685, 688 
Generalized function, 456 


differentiation, 461464 
of several variables, 479 
regular, 459 
singular, 459 
Generating function of a sequence, 467 
Gibbs’ phenomenon, 538, 549 
Graded algebra, 314 
Gradient, 204, 260, 275, 283, 675 
physical interpretation, 283 
Gradient in Cartesian, cylindrical, and 
spherical coordinates, 676 
Gram matrix, 187 
Grassmann algebra, 319, 320 
Green’s formula, 491 
Green’s function, 465 
Green’s theorem, 238-243 
Group 
cohomology, 356 
continuous, 72, 336 
discrete, of transformations, 336 
homology, 298, 357, 358 
p-dimensional, 358 
homotopy, 298 
Lie, 72, 336 
of automorphisms, 325 
one-parameter, 351 
topological, 72, 336 


H 
Haar system, 519 
Hamilton operator (nabla), 262, 265 
Harmonic analysis, 554 
Harmonic frequency, 554 
Harmonic function, 287, 304 
conjugate, 310 
Harmonic polynomials, 517 
Hausdorff space, 12, 14 
Heat capacity, 224 
molecular, 225 
Heat engine, 226 
Heat equation, 303, 576 
Heaviside function, 464, 485, 491 
Hermite polynomials, 518 
Hermitian form, 45 
nondegenerate, 45 
nonnegative, 45 
Hilbert’s fifth problem, 337 
Homeomorphism, 31 
Homological cycles, 688 
Homologous cycles, 358 
Homologous on the manifold, 690 
Homology, 358, 689, 690 
Homology class, 690 
Homology group, 298, 357 
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Homotopic paths, 294 
Homotopy, 294 

Homotopy formula, 361 
Homotopy group, 298 
Homotopy identity, 352 
Hypergeometric equation, 392 
Hypergeometric series, 391 


I 
Identity 
approximate, 451 
homotopy, 352 
Jacobi, 72 
Improper integral, 153 
depending on a parameter, 405 
with variable singularity, 474-478 
Improper integral depending on a parameter 
Abel—Dirichlet test, 418 
Cauchy criterion, 419 
continuity, 420-422 
limiting passage, 420-422 
uniform convergence, 427 
Weierstrass’ M-test, 427 
Induced atlas of the boundary, 687 
Induced orientation, 687 
Induced orientation on the boundary of a 
surface, 182 
Inequality 
Bessel’s, 502, 503 
for trigonometric system, 527 
Brunn—Minkowski, 123 
Cauchy—Bunyakovskii, 46, 448, 499 
Clausius, 227 
Holder’s, 128 
isoperimetric, 195, 543-545 
Minkowski’s, 44, 128, 489 
generalized, 489 
Steklov’s, 549 
triangle, | 
Wirtinger’s, 549 
Inertia, 307 
Inner product, 45-48, 352 
of a field and a form, 352 
Instantaneous axis of rotation, 70 
Integral, 110 
Bernoulli, 310 
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differentiation, 407-410 
integration, 410, 411 
Dirichlet, 287, 431, 443, 563, 601 
double, 111 
elliptic, 392 
complete, of first kind, 392, 408, 430 
complete, of second kind, 392, 408 
Euler—Poisson, 429, 438, 560, 572, 601 
Eulerian, 433-444 
first kind, 433 
second kind, 433 
Fourier, 555, 557, 560, 564, 571, 578, 581, 
624 
asymptotics, 625, 630 
multiple, 632 
Fresnel, 431, 443, 601 
Gauss’, 253 
improper 
differentiation with respect to a 
parameter, 423—425 
integration with respect to a parameter, 
425-429 
iterated, 129-131 
Laplace, 565, 604, 624 
asymptotics, 625, 629 
Lebesgue, 393 
line, 214 
multiple, 111 
depending on a parameter, 471-492 
with variable singularity, 476 
of a differential form 
over a surface, 217, 220 
of a form on a manifold, 344, 345 
of a function over a surface, 228, 233 
over a chain, 359 
over a set, 119 
over a singular cube, 359 
Poisson, 455, 581 
Raabe’s, 442 
Riemann, 393 
over a set, 119 
over an interval, 110 
surface 
of first kind, 233 
of second kind, 234 
triple, 111 


canonical 
asymptotics, 624 
Cauchy, 310 
Darboux 
lower, 117 
upper, 117 


depending on a parameter, 405-412 


continuity, 406, 407 


Integral criterion for the exactness of a closed 
form, 691 

Integral criterion for the exactness of forms, 
686 

Integral metric, 4 

Integral operator, 561 

Integral representation of the partial sum of a 
Fourier series, 524 
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Integral transform, 561 
Integration by parts in a multiple integral, 255 
Integration of an integral depending on a 
parameter, 410, 411 
Integration with respect to a parameter, 
425-429 
Interchange 
of differentiation and passage to the limit, 
387-391 
of integrals, 129 
improper, 425-429 
proper, 129 
of integration and passage to the limit, 
385-387 
of limiting passages, 381 
of summation and differentiation of a 
series, 389 
Interior point, 6, 13 
Interval in R”, 109 
Isobar, 224 
Isochore, 224 
Isometry of metric spaces, 24 
Isomorphism 
of normed vector spaces, 60 
of smooth structures, 335 
Isoperimetric inequality, 195, 543-545 
Isotherm, 224 
Iterated integral, 129-131 


J 

Jacobi identity, 72 

Jacobian of a coordinate change 
cylindrical coordinates, 270 
general polar, 168 
spherical coordinates, 270 
triorthogonal coordinates, 270 

Jordan measure, 121 


K 
Kernel 
Dirichlet, 525, 551 
Fejér, 551 
Poisson, 467 
Klein bottle, 170, 325 
Kotel’nikov’s formula, 579 


L 

Lagrange’s theorem, 309 

Laplace integral, 565, 604, 624 
asymptotics, 625, 629 

Laplace transform, 604 

Laplace’s equation, 304, 517 
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Laplace’s method, 603-606 
multidimensional, 623 
Laplacian, 264, 265, 274, 488 
Law 
Ampére’s, 235 
Archimedes’, 245 
Biot—Savart, 237 
Coulomb’s, 280 
Faraday’s, 235 
Gauss’, 287 
Newton’s, 289, 306, 307 
normal distribution, 466 
of conservation of mass, 280 
Law of large numbers, 664, 665 
Layer 
double, 490 
single, 488 
Legendre polynomials, 497, 498, 510, 614 
Legendre’s formula, 442 
Lemma 
Erdélyi’s, 625, 630, 632 
exponential estimate, 606, 615, 627 
Hadamard’s, 412 
Morse’s, 151, 406, 624, 628, 631 
nested ball, 27 
on continuity of the inner product, 499 
on finite e-grids, 17 
on orthogonal complement, 502 
Poincaré’s, 297 
Riemann—Lebesgue, 526, 563, 629 
Sard’s, 151 
Watson’s, 622, 625 
Lemma due to Lévy, 665 
Lie algebra, 72, 348 
Lie derivative, 352 
Lie group, 72, 336 
Limit, 21, 28 
of a family of continuous functions, 
382-385 
of a family of functions, 369 
of a mapping, 28 
of a sequence, 21 
of a sequence of functions, 363 
Limit function, 363, 367 
Limit point, 5, 7, 13 
Limiting passage 
interchange, 381 
under a differentiation sign, 387-391 
under an integral sign, 385-387 
Linear transformation, 49 
Local chart, 321 
Local maximum, 88 
Local minimum, 88 
Localization principle 
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for a Fourier series, 526 

for a Laplace integral, 606 
Locally integrable function, 448 
Lorentz transformation, 587 
Low-frequency filter, 556 


M 
M-test for convergence, 374 
Manifold, 321-325 
analytic, 326 
compact, 324 
connected, 324 
contractible, 353 
embedded in R”, 163 
nonorientable, 329 
of class C™, 326 
orientable, 329 
oriented, 329 
smooth, 326 
topological, 326 
with boundary, 323 
without boundary, 323 
Mapping 
adjoint, 317 
bounded, 29 
continuous, 30-34 
at a point, 30 
continuously differentiable, 76 
contraction, 35 
derivative, 62 
higher-order, 81 
of order n, 81 
differentiable at a point, 61, 62 
differentiable on a set, 62 
homeomorphic, 31 
linear, 49 
multilinear, 49 
of class C, 326 
partial derivative, 70 
smooth, 326 
tangent, 61, 339, 349 
ultimately bounded, 29 
uniformly continuous, 33 
Mass force, 306 
Maximum, local, 88 
Mean convergence and completeness, 539, 541 
Mean value over a period, 554 
Mean-square deviation, 3, 522 
Measure 
of a set (Jordan), 121 
of an interval, 112 
Measure zero, 112, 113, 119 
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